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(54) METHOD AND DEVICE FOR MULTI-ANGLE CONNECTING AND ENCODING BIT STREAM 



(57) A method and device for interleaving bit stream 
by which multimedia data including digital picture data, 
audio data, and sub-video signals are seamless-repro- 
duced by smoothly switching videos and voices to each 
other without disturbing videos, allowing noise to be 
contained in voices, and discontinuing voices at angle 
switching sections during multi-angle reproduction from 
an optical disk on which multi-media data are recorded. 
A multi-angle system stream is constituted of a plurality 
of system streams composed of picture data and audio 
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data created at cfifferent viewing points. In the multi- 
angle system stream from which a system stream corre- 
sponding to an angle can be reproduced at every prede- 
termined unit by freely switching the system stream to 
another during reproduction, the display time of picture 
data contained in the system stream corresponding to a 
angle and the display time of audio data are made equal 
to each other for every angle at every prescribed unit at 
which the angle can be switched. 
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of plural program t?es co-^S^g^eZS ite audio'd^ ^? "^''''^'^ ^ 

from which a new title comalning ^T^H^r^T^' ^^"^'^ to senerate a bitstream 

reproducir^ said 9er,e,aterbir u^T^^^^^ ^'^^^^^ ^^^^ ^ 

Background Art 

disk or video CD formats are cTeSu JmSlSe sut>picture data recorded to laser 

desi|n^'::jh'S"i^S^Sr^^^^ r,*? ^'^"^ "^'^ 

cier,cy video compSsion Sch^es L of Z^^^ by usir,gsuch high effl- 

using data compression technioues karaote Sic onH H ncreased effective recording capacity achieved 

tranSerred toZe ^^CoSSt cx,nvem.onal laser disk applications are gradually being 

incl^irr^^a'S '^'ruSc^'^^^^esTh?^^^^^^^^ T ^" ^^^^ '^'^'"^ 
stream can be efficiently controllSSJl^SSfhiP™^^^ ^i::!^'"^' ^^'erarchical digital bit- 

processing method. and?^S^^m^iI to v^iS, is 
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To share data between plural titles and thereby efficiently utilize optical disk capacity, muJti-scene control whereby 
scene data common to plural titles and the desired scenes on the same time-base from within multi-scene periods con- 
taining plural scenes unique to particular reproduction paths can be freely selected and reproduced is desirable. 

However, when plural scenes unique to a reproduction path within the mufti-scene period are arranged on the same 
time-base, the scene data must be contiguous. Unselected multi-scene data is therefore unavoidably inserted between 
the selected common scene data and the selected multi-scene data. The problem this creates when reprodudng multi- 
scene data is that reproduction is interrupted by this unselected scene data. 

A further problem can be expected when the multi^scene data is multi-angle scene data, i.e., scene data showing 
substantially the same subject from different angles. In the case of a live sports broadcast, this multi-angle scene data 
may be obtained by recording a baseball batter, for example, with cameras in different locations. The problem is thus 
that when the user selects one of these plural angle scenes during data presentation, data from different angles is con- 
nected where the angle changes, and a natural, seamless presentation cannot be expected. 

Therefore, the <±)ject of the present invention is to provide a data structure whereby natural, seamless reproduction 
without scene data intermitting can be achieved even in such multi-angle scene periods: a method for generating a sys- 
tem stream having said data structure; a reconding apparatus and a reproduction apparatus for recording and reproduc- 
ing said system stream; and a medium to which said system stream can be recorded and from which said system 
stream can be reproduced by said recording apparatus and reproduction apparatus. 

The present application is based upon Japanese Patent Application No. 7-252734, which was filed on September 
29. 1995, the entire contents of which are expressly incorporated by reference herein. 

Disclosure of Invention 

The present invention has been developed with a view to substantially solving the above described disadvantages 
and has for its essential object to provide an improved method for encoding a bitstream for multi-angle connection. 

In order to achieve the aforementioned objective, an interleaving method which for the presentation of a bitstream 
that IS reproduced by selecting two or more data units from a bitstream comprising three or more data units contiguous 
on the same time-base is characterized by generating said bitstream by arranging the selected data units in a particular 
sequence on the same time-base based on the presentation time of each data unit so that It is possible to sequentially 
access all data units and present only the selected data units without time-base intermittence, and is characterized by 
dividing said data units into shortest-read-time data units, and generating said bitstream by arranging the shortest-read- 
time data units in a particular sequence on the same time-base based on the shortest read time each shortest-read- 
time data unit so that it is possible to sequentially access all shortest-read-time data units and present only the shortest- 
read-time data units of the selected data units without time-base intermittence. said presentation time of each shortest- 
read-time data unit being the same. 

Brief Description of Drawings 

Fig. 1 is a graph schematically showing a structure of multi media bit stream according to the present invention. 

Fig. 2 is a block diagram showing an authoring encoder according to the present invention. 
40 Fig. 3 is a block diagram showing an authoring decoder according to the present invention. 

Fig. 4 is a side view of an optical disk storing the multi media bit stream of Fig. 1 , 

Fig. 5 is an enlarged view showing a portion confined by a circle of Fig. 4, 

Fig. 6 is an enlarged view showing a portion confined by a cirde of Fig. 5. 

Fig. 7 is a side view showing a variation of the optical disk of Fig. 4. 
45 Fig. 8 is a side view showing another variation of the optical disk of Fig. 4, 

Fig. 9 is a plan view showing one example of track path formed on the recording surface of the optical disk of Fig. 4 

Fig. 10 IS a plan view showing another example of track path formed on the recording surface of the optical disk of 

Fig. 4, 

Fig. 1 1 is a diagonal view schematically showing one example of a track path pattern formed on the optical disk of 
50 Fig. 7. 

Fig. 12 is a plan view showing another example of track path formed on the recording surface of the optical disk of 
Fig. 7. 

Fig. ,13 is a diagonal view schematically showing one example of a track path pattern formed on the optical disk of 
Fig. 8. 

55 Fig. 14 is a plan view showing another example of track path formed on the recording surface of the optical disk of 
Fig. 8, 

Fig. 15 is a graph showing the audio waves resulting from the audio data r«:orded to the multi-angle data within 
multi-angle scene period. 
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Rg. 28 is a graph schematically showing an encoding information tables. 
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Rg. 54 .s a flow Chart shoving the encode parameters generating operation for a seamless switching. 
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Fig. 55 is a flow chart showing the encode parameters generating operation for a system stream, 
Fig. 56 is a flow chart showing the operation of the DVD encoder of Fig. 26. 

Fig. 57 is a flow chart showing details of the multi-angle non-seamless switching control routine of Fig. 56, 
Fig. 58 is a flow chart showing details of the multi-angle seamless switching control routine of Fig, 56. 
5 Fig. 59 is a flow chart showing details of the parental lock sub-routine of Fig. 56. 

Fig. 60 is a flow chart showing details of the single scene subroutine of Fig. 56, 

Fig. 61 is a flow chart showing the encode parameters generating operation for a system stream containing a single 
scene, 

. Figs. 62 and 63:are graphs showing decoding information tatrfeproduce^^^ 

. Fig. 64 is a flow chart showing details oir^roduction extracted PGC routing of Fig^ 69, 
Fig. 65 is a flow chart showing details of non-seamless multi-angle decoding process of Fig. 70. 
Fig. 66 is a block diagram showing details of the stream buffer of Fig. 26. 

Fig. 67 is a flow chart showing details of decoding data process of Fig. 64. performed by the stream buffer is 
15 shown. 

Fig. 68 is a flow chart showing details of the decoder synchronization process of Rg. 67. 
Fig. 69 is a flow chart showing the operation of the DVD decoder DCD of Fig. 26. 

Fig. 70 is a flow chat showing details of the stream buffer data transfer process according to the present invention 
Fig. 71 is a flow chart showing details of the non multi-angle decoding process of Fig. 70, 

20 Fig. 72 is a flow chart showing details of the non-multl-angled interleave process of Fig. 71 , 
Fig. 73 is a flow chart showing details of the non-multi-angled contiguous block process, 
Fig. 74 is a flow chart showing details of the non-multi-angle decoding process of Fig. 70. 
Fig. 75 is a flow chart showing details of the seamless multi-angle decoding process of Fig. 70. 
Figs. 76 and 77 are graphs in assistance of explaining the switching between scene angles ^thin a multi-anale 

25 scene period. =7 

Fig. 78 is a graph in assistance of explaining a method for achieving the data structure shown in Fig. 46 

Fig. 79 is a graph in assistance of explaining a method for actually setting the audio data presentation times on the 

smallest angle switching unit level to the same value in different angles, and 

Fig. 80 is a graph in assistance of explaining the multi-angle scene period data structure in which common audio 
data IS written to each different angle according to the present invention. 

Best Mode for Can*ying Out the Invention 

The prevent invention is detailedly described with reference to the accompanying drawings. 
Data structure of the authoring svstem 

The logic structure of the multimedia data bitstream processed using the recording apparatus, recording medium 
reproduction apparatus, and authoring system according to the present invention is described first below with reference 
40 to Fig. 1 . 

In this structure, one title refers to tiie combination of video and audio data expr^ing program content recognized 
by a user for education, entertainment, or other purpose. Referenced to a motion picture (movie), one titie may corre- 
spond to tile content of an entire movie, or to just one scene within said movie. 

A video title set (VTS) comprises the bitsti-eam data containing tiie information for a specific number of tities More 
specifically, each VTS comprises the video, audio, and other reproduction data representing the content of each titie in 
the set. and control data for confrolling the content data 

The video zone VZ is the video data unit processed by ttie authoring system, and comprises a specific number of 
video title sets. More specifically, each video zone is a linear sequence of K + 1 video title sets numbered VTS #0 - VTS 
#K where K is an integer value of zero or greater. One video title set. preferably the first video titie set VTS #0 is used 
as the video manager descrtoing the content information of tiie tities contained in each video titie set 

The multimedia bitstream MBS is the largest oortrol unit of the multimedia data bitstream handled by tiie autfioring 
system of the present invention, and comprises plural video zones VZ. 
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A preferred embodiment of the auttioring encoder EC according to the present invention for generating a new mul- 
timedia bitstream MBS by re-encoding the original multimedia bitstream MBS according to the scenario desired by ttie 
user is shown in Fig. 2. Note tiiat tiie original multimedia bitstream MBS comprises a video sb-eam St1 containing tiie 
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plural sties are referred to below as muSll sT^rrT ^"^ ^"'^P'*^^^ *°r 

.deo^^crr?0?.L*L^S^^^^^ 

^O.au.los.ea.b^r800.syste.er,c«.er«,o%ro:rS^^^^ 

s^u^re for^aSniSr"" ""^"^^ ^''"^ ""i^''* ^OOO- ^^atter 1100. and volume .r^ file 

only to L'SSrdrsr'"' ^"''"'"^ ^"'^"^^^ P--* e-^o^i-am is recoiled by way of exarrpie 

Instril^S^nTS^sc^ia^J^^^^ — - data, i.e.. the user-defined editing 

the user's manipulation o, Si^vStlb^SfLS^SS^^^^^^ """"^'^ ''!^^"' ^^--^-^ *S 

editor 100 preferably conprises a display^terfS kVvLoT'^pf ^ '™^'*""«lia title, "mis scenario 

100 is connected to an adernal multirn^^«Ti^^^ . ^1 ' ° ^"^ ^'^""^ '^^ scenario editor 

are supplied. multimedia bitstream source from which the multimedia source data Sti . St3, and 

andSirto^St^e^^^^^^ 

desired scenario using the keyboard, r^ran^ coml^^^^ ^ !" ^® '° """^ ^"^^ to the 

°"rrnrdr^.-S:;r"Ti^^^^^ 

afthesourd^rcS2.LgSL:wrnS^^^^^ 

to reproduce the scenario (sequence) intended by the^seT Bas^;^^^"! ^ source data is reassembled 
or other control device, the CPU cod^ the rxTffion ten^ o^f*? , ^ received through the keyboaitl 

the respective multimedia source^? ^ ea'SSi S'^^h ST^ ^^"^^ t,nr«-based positions of the edited fTrts of 

Thescurce ^ream buffer has at e^'^^^us^.^S^^^^ ^ St7. 

and St5 a known time Td and then output strSS?^ an^S^ mulhmed.a source data streams St1 . St3. 

and^roenr^^r^e^^ri^^^^^^ 

time Td is required to determine Srcrrrte^ cSTe^KrJiS^^^^^^^ "^-^ ^""^'"^ immediately follows editing 
St7 as will be described further belowTa rlutt t^ '^f^ P™'^^^ O" the scenario date 

nize the editing process during the aSuaTencSm S^in^ r source data must be delayed by time Td to synchro- 
to synchronire the operation^^e S^ls sSS^Sn^^^^^ ™ limited to the time required 

.esourcestreambufferisnormaliyachl^e^Cea^^^^^^^^ 

case, the source stream bSfer r^^be a ^Sci^cTft^TtSSae^^^^ the complete title or longer. In this 

or optical disk ^ ' ^t^f^Se medium such as video tape, magnetic disk, 

S.,. S., an. S« „a »^ a«„ -SarSt^^rT^rrra^'TSar^aSTe^^ 
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encoding parameter signals St9, St11. and St13. 

More specifically, encoding parameter signal St9 is the video encoding signal specifying the encoding timing of 
video stream St1 to extract the encoding segment from the video stream Sti and generate the video encoding unit 
Encoding parameter signal St11 is likewise the sub-picture stream encoding signal used to generate the sub-picture 
5 encoding unit by spedfying the encoding timing for sub-picture stream St3. Encoding parameter signal Sti 3 is the audio 
encoding signal used to generate the audio encoding unit by specifying the encoding timing for audio stream St5. 

Based on the time-base relationship between the encoding segments of streams Sti , StS. and St5 in the multime- 
dia source data contained in scenario data St7, the encoding system controller 200 generates the timing signals St21 , 
St23, and St25 arranging the encoded multimedia-encoded stream in the specified time-base relationship. 
10 The encoding system controller 200 also generates the reprcxJuction time information IT defining the reproduction 
. time of the-title editing unit (video object, VOB), and the stream encoding data St33 defining the system encode param- 
eters for multiplexing the encoded multimedia stream containing video, audio, and sub-picture data. Note that the repro- 
duction time information IT and stream encoding data St33 are generated for the video object VOB of each title in one 
video zone VZ. 

15 The encoding system controller 200 also generates the title sequence control signal St39. which declares the for- 
matting parameters for formatting the title editing units VOB of each of the streams in a particular time-base relationship 
as a multimaiia bitstream. More specrficaily, the title s^uence control signal St39 is used to control the connections 
between the title editing units (VOB) of each title in the multimedia bitstream MBS, or to control the sequence of the 
interleaved title editing unit (VOBs) interleaving the title editing units VOB of plural reproduction paths. 
20 The video encoder 300 is connected to the source stream buffer of the scenario editor 100 and to the encoding sys- 
tem controller 200, and receives therefrom the video stream St1 and video encoding parameter signal St9. respectively 
Encoding parameters supplied by the video encoding signal StS include the encoding start and end timing, bit rate the 
encoding conditions for the encoding start and end, and the material type. Possible material types include NTSC or PAL 
video signal, and telecine converted material. Based on the video encoding parameter signal St9, the video encoder 
25 300 encodes a specific part of the video stream Sti to generate the encoded video stream St1 5. 

The sub-picture encoder 500 is similarly connected to the source stream buffer of the scenario editor 100 and to 
the encoding system controller 200, and receives therefrom the sub-picture stream StS and sub-picture encoding 
parameter signal Sti 1 , respectively. Based on the sub-picture encoding parameter signal Sti 1 , the sub-picture encoder 
500 encodes a specific part of the sub-picture stream StS to generate the encoded sub-picture stream Sti 7 
30 The audio encoder 700 is also connected to the source stream buffer of the scenario editor 1 00 and to the encoding 
system controller 200, and receives therefrom the audio stream StS and auiio encoding parameter signal StIS, which 
supplies the encoding start and end timing. Based on the audio encoding parameter signal St13. the audio encoder 700 
encodes a specific part of the audio stream StS to generate the encoded audio stream Sti 9. 

The video stream buffer 400 is connected to the video oicoder 300 ar^J to the encoding system controller 200 The 
35 Video stream buffer 400 stores the encoded video stream St 1 5 input from the video encoder 300, and outputs the stored 
encoded video stream Sti 5 as the time-delayed encoded video stream St27 based on the timing signal St21 suoolied 
from the encoding system controller 200. 

The sub-picture stream buffer 600 is similarly connected to the sub-picture encoder 500 and to the encoding sys- 
tem controller 200. The sub-picture stream buffer 600 stores the encoded sub-picture stream Sti 7 output from the sub- 
40 picture encoder 500. and then outputs the stored encoded sub-picture stream Sti 7 as time-delayed encoded sub-pic- 
ture stream St29 based on the timing signal St23 supplied from the encoding system controller 200. 

The audio stream buffer 800 is similarly connected to the audio encoder 700 and to the encoding system controller 
200. The audio stream buffer 800 stores the encoded audio stream St19 input from the audio encoder 700 and then 
outputs the encoded audio stream Sti 9 as the time-delayed encoded audio stream St31 based on the tirning signal 
45 St2S supplied from the encoding system controller 200. 

The system encoder 900 is connected to the video stream buffer 400, sub-picture stream buffer 600. audio stream 
buffer 800. and the encoding system controller 200, and is respectively supplied thereby with the time-delayed encoded 
video stream St27, time-delayed encoded sub-picture stream St29, time-delayed encoded audio stream St31 and the 
stream encoding data St33. Note that the system encoder 900 is a multiplexer that multiplexes the time-delayed 
^"^ °" ^re^rr\ encoding data St33 (timing signal) to generate title editing unit 

(VOB) St35. The stream encoding data St33 contains the system encoding parameters, including the encodinq start 
and end timing. ^ 

The vid^ zone formatter 1300 is connected to the system encoder 900 and the encoding system controller 200 
from which the title editing unit (VOB) St35 and title sequence control signal St39 (timing signal) are respectively sup- 
plied. The title sequence control signal St39 contains the formatting start and end timing, and the formatting parameters 
used to generate (format) a multimedia bitstream MBS. The video zone formatter 1 300 rearranges the title editing units 
(VOB) St35 in one video zone VZ in the scenario sequence defined by the user based on the title sequence control sig- 
nal St39 to generate the edited multimedia stream data St43. 
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plied to the synchronizer 2900 through the decoding system controller 2300 as the synchronization control data St81 . 

Based on this synchronization control data St81, the synchronizer 2900 determines the decoding start timing 
whereby each of the bitstreams will be arranged in the correct sequence after decoding, and then generates and inputs 
the video stream decoding start signal St89 to the video decoder 3800 based on this decoding timing. The synchronizer 
2900 also generates and supplies the sub-picture decoding start signal St91 and audio stream decoding start signal 
St93 to the sub-picture decoder 3100 and audio decoder 3200, respectively. 

The video decoder 3800 generates the video output request signal St84 based on the video stream decoding start 
signal St89. and outputs to the video buffer 2600. In response to the video output request signal St84, the video buffer 
2600 outputs the video stream St83 to the video decoder 3800. The video decoder 3800 thus detects the presentation 
time information contained in the video stream St83, and disables the video output request signal Sti54 when the length 
of the received video stream St83 is equivalent to the specified presentation time. A video stream equal in length to the 
specified presentation time is thus decoded by the video decoder 3800. which outputs the reproduced video sianal 
St 104 to the synthesizer 3500. 

The sub-picture decoder 3100 similarly generates the sub-picture output request signal St86 based on the sub-pic- 
ture decoding start signal St91. and outputs to the sub-picture buffer 2700. In response to the sub-picture output 
request signal St86. the sub-picture buffer 2700 outputs the sub-picture stream St85 to the sub-picture decoder 3100. 
Based on the presentation time information contained in the sub-picture stream St85, the sub-picture decoder 3100 
decodes a length of the sub-picture stream St85 con-esponding to the specified presentation time to repnxluce and 
supply to the synthesizer 3500 the subiDicture signal St99. 

The synthesizer 3500 superimposes the video signal St104 and sub-picture signal St99 to generate and output the 
multi-picture video signal St105 to the video data output terminal 3600, 

The audio decoder 3200 generates and supplies to the audio buffer' 2800 the audio output request signal St88 
based on the audio stream decoding start signal St93. The audio buffer 2800 thus outputs the audio stream St87 to the 
audio decoder 3200. The audio decoder 3200 decodes a length of the audio stream St87 corresponding to the specified 
presentation time based on the presentation time information contained in the audio stream St87. and outputs the 
decoded audio stream StIOl to the audio data output terminal 3700. 

It is thus possible to reproduce a user-defined multimedia bitstream MBS in real-time according to a user-defined 
scenario. More specifically, each time the user selects a different scenario, the authoring decoder DC is able to repro- 
duce the title content desired by the user in the desired sequence by reprodudng the multimedia bitstream MBS corre- 
30 spending to the selected scenario. 

It is therefore possible by means of the authoring system of the present invention to generate a multimedia bit- 
stream according to plural user-defined scenarios by real-time or batch encoding multimedia source data in a manner 
whereby the substreams of the smallest editing units (scenes), which can be divided into plural substreams. expressing 
the basic title content are arranged in a specific time-base relationship. 
35 The multimedia bitstream thus encoded can then be reproduced according to the one scenario selected from 
among plural possible scenarios. It is also possible to change scenarios while playback is in progress, i.e.. to select a 
different scenario and dynamically generate a new multimedia bitstream according to the most recenliy selected sce- 
nario. It is also possible to dynamically select and reproduce any of plural scenes while reproducing the title content 
according to a desired scenario. 
40 It is therefore possible by means of the authoring system of the present invention to encode and not only reproduce 
but to repeatedly reproduce a multimedia bitstream MBS in real-time. 

A detail of the authoring system is disclosed Japanese Patent Application filed S^tember 27, 1996. and entitled 
and assigned to the same assignee as the present application. 
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An example of a digital video disk (DVD) with only one recording surface (a single-sided DVD) is shown in Fig. 4. 
The DVD recording medium RCl in the prefen-ed embodiment of the invention conprises a data recording surface 
RS1 to and from which data is written and read by emitting laser beam LS. and a protective layer PL1 covering the data 

50 recording surface RS1 . A backing layer BL1 is also provided on the back of data recording surface RSI . The side of the 
disk on which protective layer PL1 is provided is therefore referred to below as side SA (commonly "side Al, and the 
opposite side (on which the backing layer BL1 is provided) is referred to as side SB ("side B"). Note that digital video 
disk recording media having a single data recording surface RSI on only one side such as this DVD recording medium 
RCl is commonly called a single-sided single layer disk. 

55 A detailed illustration of area CI in Fig. 4 is shown in Fig. 5. Note that the data recording surface RSI is formed by 
applying a metallic thin film or other reflective coating as a data layer 4109 on a first transparent layer 4108 having a 
particular thickness T1 . This first transparent layer 4108 also functions as the protective layer PL1 . A second transpar- 
ent substrate 41 1 1 of a thickness T2 functions as the backing layer BL1 , and is bonded to the first transparent layer 
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4108 by means of an adhesive layer 41 10 disposed therebetween 

4111 (baLg layereu r^ onl ^ra^ n^^^ surface area of the second tmnsparent substrate 

s trar«parent subiate 41 1 1 to «J.ich ^Z^S^^ii ,? the text and graphics of the disk label. The area of second 
data iVyer 41 09 (melalHc L f iZ tminaTe Ste"^^^^^ ^ " ""1^ "^^ ^««e«ed from the 

label is not printld when th^I^^LuTdeoSil^^^^^ ca" therefore be directly observed where the 

. top^^et^pn^^^^^^^^ 

fecebr:xrt^^rm^r.^^^^^^ 

•aserbeam LS. and data is r^-SXCr^etn^Ts S^^^^^ *T ''^ « 

the pits). More specifically, the pit^d la^d^taf.St !L "enothof theintenals between 

r5 data layer 410?The?enis rttre ite a^Si?«^^^^^ 

sequences is narrower. th^^iS^ l i^enSol^^ DiL Jorxi^LT ^''^.'^'^ '"""^ ''^ 
improved. eniionai oompaa Disc (CD) . The surtece recording density is therefore greatly 

ents'j£^fe411?;:Sr^4SX:d^ 

layer 4108 with both sidesfS ^SS^^'^ti a^^Sf or^^^^ ^ *he first transparent 

invention shall not be so linrted '^^^'^'^ ^"^ «"^™"'y apprawmately 0.6 mm. but the 

small in a digital vWeo^sk sjS^m he SKS SlfS^ll ^ T "^'^^^T" "^"^"^ ' ^'^^ "S"^* 
light spot needed to read a eDNSeWat SS^ii^JS^^h? '^"^'^ * «PP^«i"«te'y 1/1-6 the 

imately l .6 times the resolution Ta c^^^elrS sitem '^^'^ ^P™- 

.aser'r:^tSi:re"te,?i:^:o^^^^^ 

utes if image quality is sacrificed hioh nuri^ Ci^ 1 °^ ^ CD system is approximately 74 min- 

recorded t? a Dm ' ^ « ^'^^ presentation time exceeding two hours can be 

^^^^T^^ is tt^erefore well-suited as a recoiling medium for video images 
8. l^SS^:^^,:^T^Z::fn?^ """^'"^ "Sasdescrib^above ^shown m Figs. 7 and 

and semi-.,anspa7^'^SrrS^SnurSc?Ri^^ T"*"^ '"^ "^l 

r^eously recorded or rep«xluceS^m m^e^r«S;Z «T ^'^^ ^^"^ "e simulta- 

fi^ recoiling surface Ssi ar^t^^TJL" r^SS'^X^ 
feces RSI and RS2 using only one of the laseTbeaS i S^h cf k, . '^'"^ *° readArwite both retx)rding sur- 
"6ingle-side.dual.|ayerdiste - 

sibie toli^^lfuSfdig^^^ ^ P-^^'ed in this example, it is also pos- 

are 1^1 as "sing^^^S^^ST^ytr Ste^"^ "^'^ ^^^"^'"9 surfaces RS. Disks thus comprLd 

mec^irrR^ 3?h^t^^^^^ ^^^^ -edia shown in Fig. 7. the DVD recording ■ 

surface RSI on side SA Bnti^^^aaS^r^^^r^^l """^ '^^ «^ ^^t^ ^e^^^'ng 

two recording surfaces are sholTone d^^te?^^^ *«* ^^^''^ O"'' 

be fbm,ed on a double-sided d^l ^iSeo dK 1 «^ .SiT^f ' """"k '"^"^"^ ^'^^ "^^ 

vide two separate laser beams LSI ^TltttoTfJ^^ recording rnedium shown in Fig. 7. it is also possible to pro- 
faces RSI a«J RS2 usinV^ngfe la^erSr? N^^^ ^ °' *° '^"^ '^"^ding sur- 
layer disk" It will also be^o^orti^^ra doX-2?^^SiS J^^ ^^^^ ''''' ^ "<*°"b'e^ided. dual- 
surfaces per Side, -mistype Of diskis ciS^-d^l*;^ nSSla erSIe^ ""'''"^ '^^^ *^ " 

is Shir: R^'sTd^TN^afa ^ -""^'ns medium RC 

terenceto.eo..ecir^^erer.r°Dr^^^ 
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the same known storage capacity. Note that for simplicity only the data recording track TR is shown in Fig. 9 with more 
than three sectors per revolution. 

As shown in Fig. 9, the data recording track TR is nornnally formed ciodwise inside to outside (see an'ow DrA) from 
the inside end point lA at the inside circumference of disk RCA to the outside end point OA at the outside circumference 

5 of the disk with the disk RCA rotating counterclockwise RdA. This type of disk RCA is called a dockwise disk, and the 
recording track fomied thereon is called a clockwise track TRA. 

Depending upon the application, the recording track TRB may be formed clockwise from outside to inside circum- 
ference (see arrow DrB in Fig. 10) from the outside end point OB at the outside circumference of disk RGB to the inside 
end point IB at the inside circumference oithe disk with the disk FICB rotating cloc^se RdB. Because the recording 

TO track appears to wind coumerclockwise when viewed, from the inside circumference to the outside circumference on 
disks with the recording track formed in the direction of an-ow DrB, these disks are referred to as counterclockwise disk 
RGB with counterdodcwise track TRB to distinguish them from disk RCA in Fig. 9. Note that track directions DrA and 
DrB are the track paths along which the laser beam travels when scanning the tracks for recording and playback. Direc- 
tion of disk rotation RdA in which disk RCA turns is thus opposite the direction of track path DrA, and direction of disk 

15 rotation RdB in which disk RCB turns is thus opposite the direction of track path DrB. 

An exploded view of the single-sided, dual-layer disk RC2 shown in Fig. 7 is shown as disk RC2o in Fig. 11. Note 
that the recording trades formed on the two recording surfaces run in opposite directions. Specifically, a clockwise 
recording track TRA as shown in Fig. 9 is formed in clockwise direction DrA on the (lower) first data recording surface 
RSI , and a counterclockwise recording track TRB formed in counterclockwise direction DrB as shown in Rg, 10 is pro- 

20 vided on the (upper) second data recording surface RS2. As a result, the outside end points OA and OB of the first and 
second (top and bottom) tracks are at the same radial position relative to the center axis of the disk RC2o. Note that 
track paths DrA and DrB of tracks TR are also the data read/write directions to disk RC. The first and second (top and 
bottom) recording tracks thus wind opposite each other with this disk RC. i.e., the track paths DrA and DrB of the top 
and bottom recording layers are opposite track paths. 

25 Opposite track path type. , single-sided, dual-layer disks RC2o rotate in direction RdA con-esponding to the first 
recording surface RSI with the laser beam LS traveling along track path DrA to trace the recording track on the first 
recording surface RSI. When the laser beam LS reaches the outside end point OA. the laser beam LS can be refo- 
cused to end point OB on the second recording surface RS2 to continue tracing the recording track from the first to the 
second recording surface uninterrupted. The physical distance between the recording tracks TRA and TRB on the first 

30 and second recording surfaces RSI and RS2 can thus be instantaneously eliminated by simply adjusting the focus of 
the laser beam LS. 

It is therefore possible with.an opposite track path type, single-sided, dual-layer disk RC2o to easily process the 
recording tracks disposed to physically discrete top and bottom recording surfaces as a single continuous recording 
track It is therefore also possible in an authoring system as described above with reference to Fig. 1 to continuously 
35 record the multimedia bitstream MBS that is the largest multimedia data management unit to tvra discrete recording sur- 
faces RSI and RS2 on a single recording medium RC2o. 

It should be noted that the tracks on recording surfaces RSI and RS2 can be wound in the directions opposite 
those described above, i.e., the counterclockwise track TRB may be provided on the first recording surface RSI and the 
dockwise track TRA on the second recording surface RS2. In this case the direction of disk rotation is also changed to 
40 a dockwise rotation RdB. thereby enabling the two recording surfaces to be used as comprising a single continuous 
recording track as desaibed above. For simplification, a further example of this type of disk is therefore neither shown 
nor described below. 

It is therefore possible by thus constructing the digital video disk to record the multimedia bitstream MBS for a fea- 
ture-length title to a single opposite track path type, single-sided, dual-layer disk RC2o. Note that this type of digital 

45 video disk medium is called a single-sided dual-layer disk with opposite track paths. 

Another example of the single-sided, dual-layer DVD recording medium RC2 shown in Fig. 7 is shown as disk RC2p 
in Rg. 12. The recording tracks formed on both first and second recording surfaces RSI and RS2 are clockwise tracks 
TRA as shown in Fig. 9. In this case, the single-sided, dual-iayer disk RC2p rotates counterdodwise in the direction of 
arrow RdA, and the direction of laser beam LS travel is the same as the direction of the track spiral, i.e.. the track paths 

50 of the top and bottom recording surfaces are mutually parallel (parallel track paths). The outside end points OA of both 
top and bottom tracks are again preferably positioned at the same radial position relative to the center axis of the disk 
RC2p as described above. As also described above with disk RC2o shown in Fig. 1 1 , the access point can be instan- 
taneously shifted from outside end point OA of track TRA on the first recording surface RSI to the outside end point OA 
of track TRA on the second recording surface RS2 by appropriately adjusting the foojs of the laser beam LS at outside 

55 end point OA. 

However, for the laser beam LS to continupusly acc^ the dockwise recording track TRA on the second recording 
surface RS2, the recording medium RC2p must be driven in the opposite direction (dockwise. opposite direction RdA). 
Depending on the radial position of the laser beam LS. however, it is inefficient to change the rotational direction of the 
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^Sof^fT.^ '^'^S^"*' ^"^ F*9- 12. the laser beam LS is therefore moved from the outside 

l^rrcfSS t ^'l*"^* '^""""^ ^"^^^ *° 'A °* «.e track on the second record- 

ing surface RS2 to use these physically discrete recording tracks as one logically continuous recording track 

«i™«Srj^' "^r^ recor^vQ tracks on top and bottom recording surfaces as one continuous recording tracK It 

ilfSSro Sk ?«?o"^'^ ""f^ *° *^ ^^^^^ MBS for different titles. This ty^ g 

K?? 2. ^ If «"d.ng medium is called a "single-sided, dual-layer disk with parallel track paths " ^ °'9 

Note thai If the direction of the tracks formed on the recording surfaces RS1 and RS2 is opposite that described 

above exceptfbr the direction of disk rotation, which is clockwise as shown by arrow RdB 

°' «'""'«'^l°'=^se recording tracks, the single-sided, dual-layer disk RC2p with parallel 
track paths thus descnbed is well-suited to storing on a single disk encyclopedia and similar multimedia bit^eams 
conpnsmg multiple titles that are frequently and randomly accessed murameaia Ditstreams 

eSS ti^?RA?rn^iH!?on^^ '^!?' ® " ^''^ ^^^'^'"O '""^'"^ RC3S in Rg. 13. Clockwise 

IL^n tlT^rtlT^ r oof I^"''^'"^ ^'^^ "® ' • ^"^ « counterclockwise recortiing track TRB is pro- 
tte^ecorSno^ii T^^L^^^ 1 "''"""''"^ ''"""^'"9 media the outside end points OA and OB of 

2rtl?»«?,Si^^f/n preferably positioned at the same radial position relative to the 

center axis at the DVD recording medium RC3s. 

t«,n!IStrf L**"'^ ^^l'^""^"^ °" '■^""""9 ^""^ RS2 rotate in opposite directions the 

track ^ths are symmetncal. Thrs type of recording medium is therefore known as a douWe-sidSdual lay^diS with 

'""^""''"^ ^^^^^^-^^ -y-^t-al track paths RC^s r,St2ln Eon S 
«rt^enread.ng^vntng the first recort^^^ surface RSI. Asa result, the track path on the second recording surface RS2 

SrSci'^S ^^'pfs'^^f' I^^ '? r''* '^-^^ "^^A. Accessing Sot^TeSrSn 

^2 o?nnn !^^n T^i.^^'^ ^^^^ ^ ^^^^ irrespective of whether access is contin- 

t^e^rSr ^nTsSJX^Sr "^^^ ^^'^'^'^ '^'"^ ^'^^ -'^^ °n 

Noto'^«?i!!h*"L^^'^'^ °* ^'^ douWe-sided single layer disk RC3 shown in Rg. 8 is shown in Rg. 14 as disk RCSa 
^vSh t?e ^r^oSr' cloJ«rtse recording tracks TRA as shown in Fig. 9 on both record^ surfaces RSI and 
r ^ P°'"*^ OA and OA of the recording tracks on each record 

R^S^nnteThedouS'^'^LT^^ 

RC3a^ Unhkethe douWe-sided dual layer disk with symmetrical track paths RC3s described above the tracks on these 
r«jord,ng surfac^RSI and RS2 are asymmetrical. This type of disk is therefore known as a ^ut^^T JiS^uaHaTer 
d relJn T"^. ™' double-sided dual layer disk with asymmetrical tmck paths Rcfa nS^is fn 

surface RS2 on the opposrte side is opposite the direction DrA in which the track winds, i.e., direction DrB 
«nrJl!n ♦h.T^ 'L^ 'aser beam LS is driven continuously from the Inside circumference to the outside drcumfer- 
si^d rl^^^ recording surface RSI . and then from the outside circumference to the inside circumference o7^e 

^T^!^^? r w^' °' '^"^ «03a can be readA«ritten without turning the dS 

over and without providing different laser beams for the two sides 

Thetrack paths for recording surfaces RSI and RS2 are also the same with this double-sided dual layer disk with 

S2 in iS^.^L!r=f ^ 1*^ ^des. and the rerd^vrite app^- 

ratus can therefore be constructed economically. ^ 

tradlVfiBi^'nSl^'l^n^'r* this recording medium remains functionally Identical even if counterclockwise recoiding 
track TRB is provided in place of clockwise recording tra* TRA on both recording surfaces RSI and RS2 

oacii^n^ ^''"^K *® °* ^ ^y^**'" "^^■■^^y ^°rage capacity of the recording medium can be 

S um^i ^"^H^^ '"""'P'^ '"'^^ *^ ^^^l'^^* multimedia^plications wherebrS^rdeo 

aSeTer^Sbyt^fr^^ 

It is therefore possible to achieve one long-standing desire of software (programming) providers, specifically to oro- 
..de programming cori^ent such as a commercial movie on a single recordirig nLium in plural ve'sSr S^ert lan- 
guage and demographic groups while retaining the image quality of the original. 

Parental control 

of inSlS ^r^^"^ °11T.'® ^ ^'^^ conventionally had to produce, supply, and manage the inventory 

of individual titles in multiple languages, typically the language of each distribution rnari^et. and multi-rated titte S 
ages conforming to the parental control (censorship) regulaUons of individual countries in Europe Zf North A^S 
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The time and resources required for this are significant. While high image quality is obviously important, the program- 
ming content must also be consistently reproducible. 

The digital video disk recording medium is close to solving these problems. 

5 Multiple angles 

One interactive operation widely sought in multimedia applications today is for the user to be able to change the 
position from which a scene is viewed during reproduction of that scene. This capability is achieved by means of the 
- multiple angle function: , :- . 

IP . _ .This multiple angle function makes possible applications whereby, for example, a user can watch a baseball game 
from different angles (or virtual positions in the stadium), and can freely switch between the views while viewing is in 
progress. In this example of a baseball game, the available angles may include a position behind the backstop centered 
on the catcher, batter, and pitcher; one from behind the backstop centered on a fielder, the pitcher, and the catcher: and 
one from center field showing the view to the pitcher and catcher. To meet these requirements, the digital video disk 
15 system uses MPEG, the same basic standard format used with Video-CDs to record the video, audio, graphics, and 
other signal data. Because of the differences in storage capacity, transfer rates, and signal processing performance 
within the reproduction apparatus, DVD uses MPEG2, the compression method and data format of which differ slightly 
from the MPEG1 format used with Video-CDs. 

It should be noted that the content of and differences between the MPEG1 and MPEG2 standands have no direct 
20 relationship to the intent of the present invention, and further description is therefore omitted below (for more informa- 
tion, see MPEG specifications ISO-11172 and ISO-13818). 

The data structure of the DVD system according to the present invention is described in detail below with reference 
to Figs. 16, 17, 18, 19, 20, and 21. 



25 Multi-scene control 



A fully functional and practical parental lock playback function and multi-angle scene playback function must enable 
the user to modify the system output in minor, subtle ways while still presenting substantially the same video and audio 
output. If these functions are achieved by pr^ring and recording s^sarate titles satisfying each of the many possible 
parental lock and multi-angle scene playback requests, titles that are sulDstantially identical and differ in only minor ways 
must be recorded to the recording medium. This results in identical data being repeatedly recorded to the larger part of 
the recording medium, and significantly reduces the utilization efficiency of the available storage capacity. More partic- 
ulariy, it is virtually impossible to record discrete titles satisfying every possible request even using the massive capacity 
of tiie digital video disk medium. While it may be concluded ttiat this problem can be easily solved by increasing the 
capacity of the recording medium, tiiis is an obviously undesirable solution when the effective use of available system 
resources is considered. 

Using multi^scene control, the concept of which is described in another section below, in a DVD system, it is possi- 
ble to dynamically consfruct tities for numerous variations of tiie same basic content using the smallest possiiDle amount 
of data, and thereby effectively utilize tiie available system resources (recording medium). More specifically, titles that 
can be played back witii numerous variations are consti-ucted from basic (common) scene periods containing data com- 
mon to each title, and multi-scene periods comprising groups of different scenes corresponding to the various requests. 
During reproduction, ttie user is able to ti^eely and at any time select particular scenes from tiie multi-scene periods to 
dynamically construct a title conforming to tiie desired content, eg., a title omitting certain scenes using the parental 
lock control function. 

Note that multi-scene control enabling a parental lock playback control function and multi-angle scene playback is 
described in another section below with reference to Rg. 21 . 

Data structure of the DVD svstem 

The data sti-ucture used in tiie autiioring system of a digital video disk system according to the present invention is 
shown in Fig. 22. To record a multimedia bitstream MBS. this digital video disk system divides tiie recording medium 
into three major recording areas, ttte lead-in area LI, the volume space VS. and ttie lead-out area LO. 

The lead-in area LI is provided at ttie inside circumference area of tiie optical disk. In the disks described with ref- 
erence to Figs. 9 and 10, the lead-in area LI is positioned at tiie inside end points lA and IB of each track. Data for sta- 
bilizing the operation of tiie reproducing apparatus when reading starts is written to the lead-in area LI. 

The lead-out area LO is con-espondingly located at the outside circumference of the optical disk. i.e.. at outside end 
points OA and OB of each track in the disks described witti reference to Figs. 9 and 10. Data identifying tine end of the 
volume space VS is recorded in this lead-out area LO. 
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desai^*S»ve" """^'^ ^ -"«-edia brtstream MBS shown in Fig. 1 and 

the entire disk, and is a 'Zu^^^i^Znn S^rr^^'^ Tr!^ '^"''"^ *° ^" *° '^"«9« 

written to the volume file str..nh.™ x/pc Tr 'IZJ .J'!?''"^''"" ^o^*" ^ t^efile data structure area FDS is 

The file data structure ^FDS t^^^ specification such as ISO-9660 or ISO-13346. 

- >^GsizedtoaniSe"l«SS^^heT^^^^^^^ each comprising a video manager 

- VTB#k (where k is a natural nu,*er!San?oof " ^ ^ ^ 

volu^emrprrrSSf^^^^^^^ 

^^A^v^eot«esetV^S#kis^soca.ledaVideofOeVepresen«ng:?roUing^d^^ 
pris^^sXSo?;^?,S;SSeTan^^ 

VOB rVTSTT VOsTi I 1 management information for the entire disk, and the VTS title video oblertl 

described first 

VTsISgS? '^'"^"^ "'^'"'^ --"-Sen^ent table VTSLMAT and V7BPQC in1om«tion tatte 

the nu4^S S:STrudTi^^-r^^^ 

title set VTS locationlstoSTe aSS? ' "^^^ """"^^^ °* sut>pictures. and the video 

a data entry expressing the-p.^ram Sa^a^ coSSf rS,'^"^^^^^ °' VTS.PGCI #i is 

play the top mZ#. «Z n^tT^^er^^^tt^^^^^ "^Z!""^ *° ^'^'^ '"tor"««on and dis- 

may be displayed, for sample by' pr^rt^S^^^^ 

accessed using the numeric keypad on the Lote coTrol pS?#S In^hl!!^' "^^^ 

tional submenus further down the hierarchy. AHernaSy VTS PGcrrf^Sl!^^!^^ correspond to addi- 

the MENU button, while VTS PGCI #2 i^Z^T^L\Lf;:^^^ *^ "^^ ^J^^ *°P "^^y^ by pressing 
numeric key ~ '"^^ ''^ 9"'dance reproduced by pressing the corresponding 

mayI^e^frry"i:rct^Tn rHoTrys^'rstKbS^^^^^^ « — 

containing voice guidance. *° fi'^^'^hical or non-hierarchical menus or menus 

whe;;r^r^nfpia^;srceTefe^^^^^^^^^^ 

and reproduces the system sTim P'^Vback sequence described by the program chain PGC. 

STOOP, ^ ,es«.^ r?5B'W2nrjf^^,xiSp''S"^;^»s-s2'ss2 
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C_FVOBU_SA. and the last cell VOBU start address C_LVOBU_SA. 

Note that seamless playback refers to the reproduction in a digital video disk system of multimedia data indudina 
video, audio, and sub-picture data without intermittent breaks in the data or information. Seamless playback is 
described in detail in another section below wHh reference to Fig. 23 and Hg. 24. 

5 The cell block mode CBM indicates whether plural cells constitute one functional block. The cell playback informa- 
tion of each cell in a functional block is arranged consecutively in the PGC information. The ceil block mode CBM of the 
first cell playback information in this sequence contains the value of the first cell in the block, and the cell block mode 
CBM of the last cell playback information in this sequence contains the value of the last cell in the block. The cell block 
mode CBM of each cell arrayed between these first and last cells contains a value indicating that the cell is a cell 

JO between these first and last cells in. that block. 

. The cell block type CBT.identifies.the type of the block indicated by the cell block mode CBM. For example when 

a multiple angle function is enabled, the cell information con-esponding to each of the reproducible angles is pro- 
grammed as one of the functional blocks mentioned above, and the type of these functional blocks is defined bv a value 
Identifying "angle" in the cell block type CBT for each cell in that block. 

IS The seamless playback flag SPF simply indicates whether the corresponding cell is to be linked and played back 
seamlessly with the cell or cell block reproduced Immediately therebefore. To seamlessly reproduce a given cell with 
the preceding cell or cell block, the seamless playback flag SPF is set to 1 in the cell playback information for that cell- 
otherwise SPF IS set to 0. 

J^.fi"*^'T^ allocation flag lAF stores a value identifying whether the cell exists in a contiguous or interleaved 
block. If the cell is part of an interleaved block, the flag lAF is set to 1 ; othenivise it is set to 0 

The STC resetting flag STCDF identifies whether the system time clock STC used for synchronization must be 
'^^l,'^®" P'^y«* "^len resetting the system time clock STC is necessary, the STC resetting flag 

o I ODi IS S6t to 1 . 

The seamless angle change flag SACF stores a value indicating whether a cell in a multi-angle period should be 
connected seamlessly at an angle change. If the angle change is seamless, the seamless angle change flag SACF is 
set to 1 ; otherwise it is set to 0. » s» a «"v^i 

The cell presentation time C_PBTM expresses the cell presentation time with video frame precision 
The first cell VOBU start address C_FVOBU_SA is the VOBU start address of the first cell in a blocK and is also 
expressed as the distance from the logic sector of the first cell in the VTS title VOBS (VTSTT VOBS) as measured hv 
30 the number of sectors. ~ « uy 

. ^'"'^ C_LVOBU_SA is the VOBU start address of the last cell in the block. The value 

Of this address is expressed as the distance from the logic sector of the first cell in the VTS title VOBS fVTSTT VOBS^ 
as measured by the number of sectors. ~ ' 

3s str J!ldrU"cl^''vSi'^^^-''°w^l'-^ ' -"""""^d'^ ^y^^^ data, is described next. The system 

3s stream data VTSTT VOBS comprises . (where i is a natural number) system streams SS. each of which is referred to 
as a video object (VOB). Each video object VOB #1 - VOB #i comprises at least one video data block interleaved with 
up to a maximum eight audio data blocks and up to a maximum 32 sub^jicture data blocks 

Each video object VOB comprises q (where q is a natural number) cells C#1 - C*q. Each cell C comprises r (where 
r IS a natural number) video object units VOBU #1 - VOBU #r. 

Each video object unit VOBU comprises plural group_of_pictures GOP. and the audio and sub-pictures corre- 
sponding to the playback of said plural group_of_pictures GOP. Note that the group_of_pictures GOP corresponds to 
tiie video encoding refresh cycle. Each video object unit VOBU also starts with an NV pack. i.e.. the control data for that 

The structure of the navigation packs NV is described with reference to Fig. 18. 

Before describing the navigation pack NV. the internal structure of the video zone VZ (see Fig 22) i e the system 
^eam Sas encoded by the authoring encoder EC described with reference to Fig. 25. is described with reference to 

? ! ^'^^ ^'^"^ ""'S ""^ the compressed one-dimensional video data 

stream encoded by the video encoder 300. The encoded audio stream St19 is likewise the coirpressed one-dimen- 
sional audio data stream multiplexing the right and left stereo audio channels encoded by the audio encoder 700 Note 
that the audio signal shall not be limited to a stereo signal, and may also be a multichannel surround-sound signal 

The system stream (title editing unit VOB) St35 is a one dimensional array of packs with a byte size corresponding 
to the logic sector LS #n having a 2048-byte capacity as described using Fig. 21. A stream control pack is placed at 
the beginning of the title editing unit (VOB) St35. i.e.. at the beginning of the video object unit VOBU. This stream control 
'pack IS called the "navigation pack NV". and records the data arrangement in the system stream and other control infor- 
55 manon. 

The encoded video stream St15 and the encoded audio stream Stl9 are packetized in byte units corresponding to 
the system stream packs. These packets are shown in Fig. 1 7 as packets V1 . V2. V3. V4... and A1 , A2 A3 As shown 
in Fig. 17. these packets are interleaved in the appropriate sequence as system stream St35, thus forming a packet 
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TrT::,::':::Z^°:Z':^^^^ ^ rec^i.ed the decoderto expand the video 

V3. V4. A2.... ^ ^ packet stream is interleaved in the sequence VI, V2. A1. 

incr^i?l?c^„^,X,,^S::V; 'L'lJ:S':^Z°TTr^ SiSn^lcantly 
processing LSI en^e tJ^D^^stem to rJS^. ^ w^J^^"^ ^"^ performance improvements in the signal 
Video data unrt in a sin^te iZea^^^eSlSemSre^^^^^^^^ .^f ''"^ (graphics data) to one 

data and sub-picture data to be reproduoS^Sfl^ifZ^' tk ST!^ *° «P«'='f '° audio 

DVD system is shov«, in F^. t Zti^^^iZ '^'''^ ^*'^ ""'^ ^^'^ 'VP- 

how^ert^eViJ n'i^^'^S^elS^^^^ ^« ^ ^^3. V4. ... in this example, 

input as the source data ^itre aS^So tJ^ S^Jl. k ^J^'^t^^ «"dio streams St19A. St19B. and siTgC 

leaved to a single system stream St35 ' ' ^^e inter- 

cif Ic number of frLes c^nS^^i^t^ o^ gS^s i^T'' "^'^ ^" ^« 

agement data containing.for exa^leTeTelatii^ nt^^^^ management pacK which describes the man- 

interval. Because thegro,^ of_^S es gVp uSte SLs^^^^ " '"^^^^^'^^ at the GOP unit 

GOP unit Changes the irten^T^Seam^J^lamorf *^"9'"9 number of video frames per 

time on the digi'tel video dSwiSin a SnTC o J^^lTn^" ^*^'L"^"«' ^'^^ temis of the presentaton 
Of contiguous plural GOP unr^TlesftJan^rc^^ *^^ referenced to the GOP unit. Ifthe presentation time 

units is interleaved to a singteil-ear^ " ^ '"^"^S^'"^"* ^^^ta packs for the video data of the plural GOP 

from'^rnaTarn"p:rNTto^^^^ 

unit VOBU. in general, one corrtiguLs pSTS*^'^^^^^^^ ^ ^ ^'deo object 

each Video Object VOB contains pluralSd^S^ u*^^^^ 
(VOBS). Note that these data unte were fi" ^int: SuSt d^ ' ^'^"^ ^ 

imerrXlluJL'^^eTmeTiv^^ 'ra'd'SSf^lnr '2'=^ '^^'"'"^ ^^'^^^^ 
GOP is normally a unit containinTi^Jmatl Tslec^ St^T? """""^ ^""^ S-^P-O^-Pictures 

required for 12 - 15 frames, and o^S^nSS^ nv il ^ • l'^ equivalent to the presentation time 
required for this presentation ti.^ ^ ^ ^^"^"""^ .nterleaved with the number of data packets 

s«tui;Te?;^eri2:td^^^^^^^ 

system stream is reoorted in a fol^at oac^oT^^ J?' ^ contained in the 

essentially the same aLdTo and^ oiS^^f o [I? *° '"'^^^ P^<^ ^^"Cture is 

capacity as described abo^,' id coSnst'SS^ ^kJT ^ '^'^'^ « ^048 byte 

packet header PTH and data bSS ^^S; each packet PES contains a 

J^^^op^^r^^^^^ 

^^^?^e%"cStr.erPT^^^^^^^^ 

Of wh?ch ?eZit;7;:Stl?^^^^^ ^ « ^«^'"9 «me stamp DTS. both 

the time at which the videTdate orTudir^r^nli^^^ 2,. SZ""?' s»amp PTS defines 

mreaaa; prl«,e pacta, 2 ca„ii mT^S i^n^olKS »« ""^S »««» *«. -na sub^^ic- 
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defined by private packet 2 may be defined as any of eight types #0 - #7 of linear PCM or AC-3 encoded data. Sub- 
picture data may be defined as one of up to 32 types #0 - #31 . 

The data area Is the field to which data compressed according to the MPEG2 specification is written if the stored 
data is video data; linear PCM. AC-3, or MPEG encoded data is written if audio data is stored; or graphics data com- 
s pressed by runlength coding Is written if sub-picture data is stored. 

MPEG2-compressed video data may be compressed by constant bit rate (CBR) or variable bit rate (VBR) coding. 
With constant bit rate coding, the video stream is input continuously to the video buffer at a constant rate. This contrasts 
with variable bit rate coding in which the video stream is input intermittently to the video buffer, thereby making it pos- 
sible to suppress the generation of unnecessary code. Both constant bit rate and variable bit rate coding can be used 
10 in the digital video disk system. 

Because MPEG video data is compressed wish variable length coding, the data quantity in each group_of_pictures 
GOP is not constant- The video and audio decoding times also differ, and the time-base relationship between the video 
and audio data read from an optical disk, and the time-base relationship between the video and audio data output from 
the decoder, do not match. The method of time-base synchronizing the video and audio data is therefore described in 
IS detail below with reference to Fig. 26. but is described briefly below based on constant bit rate coding. 

The navigation pack NV structure is shown in Fig. 20. Each navigation pack NV starts with a pack header PKH, and 
contains a PCI packet and DSI packet: 

As described above, the pack header PKH records the time at which that pack is to be sent from stream buffer 2400 
to system decoder 2500 (see Fig. 26 ), i.e.. the system clock reference SCR defining the reference time tor synchro- 
20 nized audio-visual data playback. 

Each PCI packet contains PCI General Information (PCLGI) and Angle Information for Non-seamless playback 
(NMSL_AGLI). 

The PCI General Information (PCLGI) declares the display time of the first video frame (the Start PTM of VOBU 
(VOBU_S_PTM)), and the display time of the last video frame (End PTM of VOBU {VOBU_E_PTM)). in the correspond- 
25 ing video object unit VOBU with system clock precision (90 KHz). 

The Angle Information for Non-seamless playback (NMSL_AGLI) states the read start address of the correspond- 
ing video object unit VOBU when the angle is changed expressed as the number of sectors from the beginning of the 
video object VOB, Because there are nine or fewer angles in this example, there are nine angle address declaration 
cells: Destination Address of Angle Cell #1 for Non-seamless playback (NMSL_AGL„C1_DSTA) to Destination Address 
30 of Angle Cell #9 for Non-seamless playback (NMSL_AQL_C9_DSTA). 

Each DSI packet contains DSI General Information (DSLGI), Seamless Playback Information (SML_PBI), and 
Angle Information for Seamless playback (SML_AGLI). 

The DSI General Information (DSLGI) declares the address of the last pack in the video object unit VOBU, i. e., the 
End Address for VOB (VOBU_EA), expressed as the number of sectors from the beginning of the video object unit 
35 VOBU. 

While seamless playback is described in detail later, it should be noted that the continuously read data units must 
be interleaved (multiplexed) at the system stream level as an interleaved unit ILVU in order to seamlessly reproduce 
split or combined titles. Plural system streams interleaved with the interleaved unit ILVU as the smallest unit are defined 
as an interleaved block. 

40 The Seamless Playback Ihfonnation (SML_PB1) is declared to seamlessly reproduce the stream interleav«j with 
the interleaved unit ILVU as the smallest data unit, and contains an interleaved Unit Flag (ILVU flag) identifying whether 
the con-esponding video object unit VOBU is an interleaved block. The ILVU flag Indicates whether the video object unit 
VOBU Is in an interieaved block, and is set to 1 when it is. Othenwise the ILVU flag is set to 0. 

When a video object unit VOBU is in an interleaved block, a Unit END flag Is declared to indicate whether the video 
45 object unit VOBU Is the last VOBU in the interleaved unit ILVU. Because the interleaved unit ILVU Is the data unit for 
continuous reading, the Unit END flag is set to 1 if the VOBU currently being read is the last VOBU in the interleaved 
unit ILVU. Otherwise the Unit END flag is set to 0. 

An Interleaved Unit End Address (ILVU_EA) Identifying the address of the last pack in the ILVU to which the VOBU 
belongs, and the starting address of the next interleaved unit ILVU, Next Interleaved Unit Start Address (NT_ILVU_SA), 
so are also declared when a video object unit VOBU is in an interleaved block. Both the Interleaved Unit End Acfclress 
(ILVU.EA) and Next Interleaved Unit Start Address (NT_ILVU_SA) are expressed as the number of. sectors from the 
navigation pack N V of that VOBU. 

When two system streams are seamlessly connected but the audio components of the two system streams are not 
contiguous, particularly immediately before arid after the seam, it is necessary to pause the audio output to synchronize 
ss the audio and video components of the system stream following the seam. Note that non-contiguous audio may result 
from different audio signals being recording with the corresponding video blocks. With an NTSC signal, for example, the 
video frame cyde is approximately 33. 33 msec while the AC-3 audio frame cyde Is 32 msec. 

To enable this resynchronization, audio reproduction stopping times 1 and 2. I.e., Audio Stop PTM 1 in VOB 
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Shown in Fig. 25. H will be obSoi^s She ^Sna enSirlrn^ ^^"S . "^""^ ''^''^^ 
below as a DVD encoder is siSa I v id^S to ^Tfl *° "^'^^ ^''^^ ^'^ system, referred to 

between these encoders is "e^SSt oVD en^^^^^^^ ? "'"^J? "^'^ ^^''^ 

encoder EC above with a VOB buff^l 000 andSrX^^ !S. k ?° ^ «"*°""9 

DVD encoder ECD is rea)rded toatfaiS CSn r^J. \! ^ "'^'""^ bitstream encoded by this 

describe, b^owinconparirnSSrir^^^^^^^^^^ 

^.^T 200 generates control signals St9. St11, 

input from the scena'oSr l^o^'^^s "-^-^efined edrting instructions 

700 in the DVD encoder ECD Note ti^t^TZlr Zin^^^ I ' .^"^"P"*"''® e"«^er 500, and audio encoder 
c. the edging instructions cJSe'ro^;*^^^^^^^^ 

and how the selected sourS datT ilrLse^l t ^L^^^ "^'""^ P'"^^' "'^ * period, 
nario data St7 of the DVD "r^^^ 
tained in the editing units whi^^re oLi^ ^ 'nformation as: the number of streams con- 

imen«.; the nu^r o?Sio aS^^ "^'^^a^^^^^^^ ^^^"^ '"^ '"'^^ « «>"-^"t time 

period: whether the title is a mum^^lren^lino n^rSfJT ^ TT"- ^"-picture display time and 

plural streams including, for eZpte ^^Se ^^^^^^^ "^^ ^e'ected from 

switched among the multiple vi Jig JJ^IJ ^ ""^"^ °* connecting scenes when the angle is 

each control, a^ whether rsr:^^ rnS^^^ur-n^rb?^^^^^^^ 

enc^ng parameters are described'^TfiS^^ToRS^ '""^'"^ ^'^ ^ 

endlJjnr^ir rSi^^ nrsS^^^^^^^ 

include the condWone tofconnedinoonevkleo nM<S wSiZ^™^ J? ya""" aHeam enoodin!, parameters 
the a»llo encoding lnfbrn«on M aSto ttiT^iST^h^ "efoi^and after. tl» number ol audio streams, 
star^g time »^.on VPTS, a« ^a J£^LSSJn?.iS„^„"^=r*'' * ^ ^ 

n»ti2;'aS°sr^,rStSr^4r^r"^s'?^^'^^™»"'*"-'»«««^ 

defined m ISO-I3S18, specTic eJSS™ □ai^JSS^.t^CS^i,^"'^''''"''^"''^ Video standaM 
.= encoding ata,,and^.^ng.«rrL":S;'gr»rirs:X"a^^^ 
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including whether the material is an NTSC or PAL video signal or telecine converted material, and whether the encoding 
mode is set for either open GOP or closed GOP encoding. 

The MPEQ2 coding method is basically an interframe coding method using the correlation between frames for 
maximum signal compression, i.e.. the frame being coded (the target frame) is coded by referencing frames before 
and/or after the target frame. However, intra-coded frames, i. e. . frames that are coded based solely on the content of 
the target frame, are also inserted to avoid error propagation and enable accessibility from mid-stream (random 
access). The coding unit containing at least one intra-coded frame ("intra-frame") is called a group_of_pictures GOR 

A group_ofj3ictures GOP in which coding is dosed completely within that GOP is known as a "closed GOR " A 
group_of_pictures GOP containing a frame coded with reference to a frame in a preceding or following (ISO-13818 
DOES NOT LIMIT P- and B-picture CODING to referencing PAST frames) group_of_pictures GOP is an "open GOR" 
It IS therefore possible to playback a closed GOP using only that GOR Reproducing an open GOP. however also 
requires the presence of the referenced GOR generally the GOP preceding the open GOR 

The GOP is often used as the access unit For example, the GOP may be used as the playback start point for repro- 
ducing a title from the middle, as a transition.point in a movie, or for fast-fonward play and other special reproduction 
modes. High speed reproduction can be achieved in such cases by reproducing only the intra-frame coded frames in a 
GOP or by reproducing only frames in GOP units. 

B^ed on the subuicture stream encoding parameter signal Sti 1 . the subijicture encoder 500 encodes a specific 
part of the sub-picture stream St3 to generate a variable length coded bitstream of bitmapped data. This variable length 
coded bitstream data is output as the encoded sub-picture stream St1 7 to the sub-picture stream buffer 600 

Bas^on the aucfio encoding parameter signal St13. the audio encoder 700 encodes a specific part of the audio 
stream St5 to generate the encoded audio data. This encoded audio data may be data based on the MPEG1 audio 
standard defined in ISO-11172 and the MPEG2 audio standard defined in ISO-13818. AC-3 audio data or PCM 
(LPCM) data. Note that the methods and means of encoding audio data according to these standards are known and 
commonly available. 

The video stream buffer 400 is connected to the video encoder 300 and to the encoding system controller 200 The 
video stream buffer 400 stores the encoded video stream St 15 input from the video encoder 300 . and outputs the stored 
encoded video stream Sti 5 as the time-delayed encoded video stream St27 based on the timing signal St21 suDoOed 
from the encoding system controller 200. 

The sub-picture stream buffer 600 is similarly connected to the subi>icture encoder 500 and to the encoding sys- 
tem controller 200. The sub-picture stream buffer 600 stores the encoded sub-picture stream Sti 7 input from the sub- 
picture encoder 500. and then outputs the stored encoded sub-picture stream St17 as time^layed encoded subuic- 
ture stream St29 based on the timing signal St23 supplied from the encoding system controller 200. 

The audio stream buffer 800 is similarly connected to the audio encoder 700 and to the encoding system controller 
200. The audio stream buffer 800 stores the encoded audio stream St19 input from the audio encoder 700 and then 
outputs the encoded audio stream S119 as the time-delayed encoded audio stream St31 based on the timing signal 
St25 supplied from the encoding system controller 200. 

The system encoder 900 is connected to the video stream buffer 400. sulH>icture stream buffer 600. audio stream 
buffer 800. and the encoding system controller 200. and is respectively supplied thereby with the time-delayed encoded 
video stream St27. time<lelayed encoded sub^jicture stream St29. time-delayed encoded audio stream St31 and the 
system stream encoding parameter data St33. Note that the system encoder 900 is a multiplexer that multiplexes the 
tiTie-delayed streams St27, St29. and St31 based on the stream encoding data St33 (timing signal) to generate title 
editing units (VOBs) St35. » » / a 

The VOB buffer 1 000 temporarily stores the video objects VOBs produced by the system encoder 900 The fbrnat- 
ter 1 100 reads the delayed video objects VOB from the VOB buffer 1 000 based on the title sequence control signal St39 
to generate one video zone V2, and adds the volume file structure VPS to generate the edited multimedia stream data 

""1® bitstream MBS St43 edited according to the user-defined scenario is then sent to the recorder 

1200. The recorder 1200 processes the edited multimedia stream data St43 to the data stream St45 format of the 
recording medium M, and thus records the formatted data stream St45 to the recording medium M. 

DVD decoder 

A preferred embodiment of a digital video disk system authoring decoder DCD in which the multimedia bitstream 
authoring system of the present invention is applied to a digital video disk system is described below and shown in Rg 
26. The authoring decoder DCD applied to the digital video disk system, refened to below as a DVD decoder DCD 
decodes the multimedia bitstream MBS edited using the DVD encoder ECD of the present invention, and recreates the 
content of each title according to the user-defined scenario. It will also be obvious that the multimedia bitstream St45 
encoded by this DVD encoder ECD is recorded to a digital video disk medium M. 
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audio decoder 3200. selecS^ sJrthLi^^^ ' T^f""^ "^^^ ^'^-P''*'^^ decoder 3100. 

3700. synthesizer 3500. video data output terminal 3600. and audio data output terminal 

na. St57: a signal proc^!;ioo8 S^roS;^S2i?g^e7e^^ « *^ ""'"^'^ 

St61 ; and a reproduction controller 2002 -^^ad signal St57 to generate the reproduced bitstream 

bitstr^^^S^^^^ig^^^^^^ 2300 from which the murtimed. 

St59r.pe.^,eo^^,^^ 

™? i:;rSu^Shn:;S^i^^^^ ^« ^..XtrS^- the authoring 

2SvTd-rScr--~ 

inpuJ'L'd^^'^TcS^^^^^ 

'"^"^rsrerTo™^^^ 

from^etSXr^l?S,rS^?hT^^ 

dock refers^? J S ^d VOBU ^iZurJ^rrrTr.^?- ^y"*'^"'^^- data SCR (system 

stream control data ^^S^m b^^2^. .^r ^J^^^lT "^^'9^**°" P^'^'^ *° 9«"erate the bit- 
supplies the generated SjJim'l^^tf ^ *° ^'"^ ^^^^^-^ ^300. to which « 

23oo^rgr:r:trrssrr"e?^^^^^ 

2000. The decoding system controller 2M0 also ^^ h? ^«"*°'' "9the operaton of the bitstream producer 
reproduction control ^a^ o^^^J^J^ "^^^^^^ 

decoding informationt^eLS:rS,?urth^*S^^ ^^'"3 control. This 

2300 also extracts the title infbrmatioTrSDrd^ririL^?^ '^^"^ ^^^"^ 

reset swem dock St79 to me deLlng i^Sl SoT ^ ^TO »,d supply ^ 

„ -^-^rTpS^rrs^Terrs^^^ 

The method of generating the stream read signal St65 is described next 
erates the reM lequest signel aSt*«?ff,n«2„ ST^^ StTS supplied Iram the synel»onizw 2900, end Ben- 

end oueule to the system decoder 2500 "itareams corresponding to the selected scenerio, 
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When a title contains plural audio tracks, e.g. audio tracks in Japanese, English, French, and/or other languages, 
and plural sub-picture tracks for subtitles in Japanese, English. French, and/or other languages, for example, a disaete 
ID is assigned to each of the language tracks. As described above with reference to Fig. 19. a stream ID is assigned to 
the video data and MPEG audio data, and a substream ID is assigned to the sub-picture data, AC-3 audio data, linear 
5 PCM data, and navigation pack NV information. While the user need never be aware of these ID numbers, the user can 
select the language of the audio and/or subtitles using the scenario selector 2100. If English language audio is 
selected, for example, the ID corresponding to the English audio track is sent to the decoding system controller 2300 
as scenario selection data St51 . The decoding system controller 2300 then adds this ID to the decoding signal St69 
output to the system decoder 2500. 
10 Based on the instructions contained in the decoding signal St69, the system decoder 2500 respectively outputs the 
video, sub-picture, and audio bitstreams input from the stream buffer 2400 to the video buffer 2600. sub-picture buffer 
2700. and audio buffer 2800 as the encoded video stream St71 . encoded sub-picture stream St73. and encoded audio 
stream St75. Thus, when the stream ID input from the scenario selector 2100 and the pack ID input from the stream 
buffer 2400 match, the system decoder 2500 outputs the corresponding packs to the respective buffers (i.e., the video 
15 buffer 2600, sub-picture buffer 2700. and audio buffer 2800). 

The system decoder 2500 detects the presentation time stamp PTS and decoding time stamp DTS of the smallest 
control unit in each bitstr^m St67 to generate the time information signal St77. This tme information signal St77 is sup- 
plied to the synchronizer 2900 through the decoding system controller 2300 as the synchronization control data St81 . 

Based on this synchronization control data St81. the synchronizer 2900 determines the decoding start timing 
20 whereby each of the bitstreams will be arranged in the correct sequence after decoding, and then generates and inputs 
the video stream decoding start signal St89 to the video decoder 3801 based on this decoding timing. The synchronizer 
2900 also generates and supplies the sub-picture decoding start signal St91 and audio stream decodinjg start signal 
St93to the sub-picture decoder 3100 and audio decoder 3200, r^pectively 

The video decoder 3801 generates the video output request signal St84 based on the video stream decoding start 
25 signal St89, and outputs to the video buffer 2600. In response to the video output request signal St84, the video buffer 
2600 outputs; the video stream St83 to the video decoder 3801 . The video decoder 3801 thus detects the presentation 
time information contained in the vfcleo stream St83, and disables the video output request signal St84 when the length 
of the received video stream St83 is equivalent to the specified presentation time. A video stream equal in length to the 
specified presentation time is thus decoded by the video decoder 3801 , which outputs the reproduced video signal St95 
30 to the reordering buffer 3300 and selector 3400. 

Because the encoded video stream is coded using the interframe correlations between pictures, the coded order 
and display order do not necessarily match on a frame unit basis. The video cannot, therefore, be displayed in the 
decoded order. The decoded frames are therefore temporarily stored to the reordering buffer 3300. The synchronizer 
2900 therefore controls the switching signal St103 so that the reproduced video signal St95 output from the video 
35 decoder 3800 and the reordering buffer output St97 are appropriately selected and output in the display order to the 
synthesizer 3500. 

The sub-picture decoder 3100 similarly generates the sub-picture output request signal St86 based on the sub-pic- 
ture decoding start signal St91, and outputs to the sub-picture buffer 2700. In response to the sub-picture output 
request signal St86. the sub-picture tjuffer 2700 outputs the sub-picture stream St85 to the sub-picture decoder 3100. 

40 Based on the presentation time information contained in the sub-picture stream St85, the sub-picture decoder 3100 
decodes a length of the sub-picture stream St85 corresponding to the specified presentation time to reproduce ar^J 
supply to the synthesizer 3500 the sub-picture signal St99. 

The synthesizer 3500 superimposes the selector 3400 output with the sut>picture signal St99 to generate and out- 
put the video signal St105 to the video data output terminal 3600. 

45 The audio decoder 3200 generates and supplies to the audio buffer 2800 the audio output request signal St88 
based on the audio stream decoding start signal St93. The audio buffer 2800 thus outputs the audio stream St87 to the 
audio decoder 3200. The audio decoder 3200 decodes a length of the audio stream St87 corresponding to the specified 
presentation time based on the presentation time information contained in the audio stream St87, and outputs the 
decoded audio stream St101 to the audio data output terminal 3700. 

so It is thus possible to reproduce a user-defined multimedia bitstream MBS in real-time according to a user-defined 
scenario. More specifically each time the user selects a different scenario, the DVD decoder DCD is able to reproduce 
the title content desired by the user in the desired sequence by reproducing the multimedia bitstream MBS correspond- 
ing to the selected scenario. ^ 

It should be noted that the decoding system controller 2300 may supply the title information signal St200 to the sce- 

55 nario selector 2100 by means of the infrared communications device mentioned above or another means. Irrteractive 
scenario selection controlled by the user can also be made possible by the scenario seleaor 2100 extracting the title 
information recorded to the optical disk M from the file data structure area FDS of the bitstream control data St63 con- 
tained in the title information signal St200, arxJ displaying this title information on a display for user selection. 



21 

BNSDOCID: <EP 0847200A1J_> 



EP 0 847 200 A1 



of these separate buffers. 
Multi-scene contrni 



. to 21 S^lSrS^*^:' «r ^^^^ *° ^'^^ - '^e-cribed below with reference 

scene period SSrgdtril^^toe^^^ ^-'-'^'^^ basic 

responding to the vario.^ scenarioT^uiJ^^ Fm 21 J^eJ efl^ «'"]P"s.ng groups of different scenes cor- 

periods. The multi-angle scenes f^SsTS andt^ h!;!f/ ' ' T ^^"^ ^asic scene 

6 and 7) between sc^iT^ ra^;;-,S.JSLene^i^^^^^ ^ ""^ ^"'^ '"^^ — ^^nes 

preselected for output in the parental locked scSe peri«l ^ ^"^"^'^ "^""^ ^ ''^^ 

desriLTRa" M^rS Jl'r' '^"^'^ Of the pragram chain infbnnation VTS PGCI is 

^^etSaJS^T^d'^'enToTh^^^^^^ 

C.PBIJ«^/.^r.i^^^^^^^^^^ C_PB.a correspo^i. to^c.e%. 

C PBS"??S^^r"pml^'l!l^"° ^ "^^'^ P'^^^'* information C_PBI#1 corresponding to scene 1 

ilal video system data^cture a scene Sich?2 cI"J^ro? n^TS ""^^"^'"S t° ^c*"® 8. According to the dig- 
thereunder, thus a scenarioTepureS b;ateJ rbTSin^' ' '^""^ ^ « « ^'^ 

mon. Withrespectto-asingletenTcomln^^^^ 

^Tgrs^^r^ ^- ---- to™;™ .^rrri™irs'^^ 

3 is constructed by VOB#4 Thus consfrurted mSf^^^?^ ^ ^^'^ ^ constructed by VOB#3, angle 

ing between eachUlet^^mTeirepS^ 
respectively.are formed as the interieavedblo<iforthe^ 

and behind thereof as well as seamless reproduction bSleen SS^SnT " ""™"°" """""" ""^"^^ 

t«e^aSrjr^s-srn%r3^:r4^^^^^^^ 

Seamless piavbark 

basic scene periods, between basic scene firiods and MrsceSe aS£won between 
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data continuity is lost when the required continuous presentation time cannot be assured. Reproduction of such infor- 
mation whereby the required continuity is assured is referred to as "contiguous information reproduction," or "seamless 
information reproduction." Reproduction of this information when the required continuity cannot be assured is referred 
to as "non-continuous information reproduction," or "non-seamless information reproduction." It is obvious that contin- 
5 uous information reproduction and non-continuous information reproduction are, respectively, seamless and non-seam- 
less reproduction. 

Note that seamless reproduction can be further categorized as seamless data reproduction and seamless informa- 
tion reproduction. Seamless data reproduction is defined as preventing physical blanks or interruptions in the data play- 
back (intermittent reproduction) as a result of a buffer underflow state, for example. Seamless information reproduction 
10 is defined as preventing apparent interruptions in the information when perceived by the user (intermittent presentation) 
when recognizing information from the playback data where there are no.actual physical breaks in the data reproduc- 
tion. 

Details Of Seamless playback 

15 

The specific method enabling seamless reprcxJuction as thus described is described later below with reference to 
Figs. 23 and 24. 

Interleaving 

20 

The DVD data system streants described above are recorded using an appropriate authoring encoder EC as a 
movie or other multimedia title on a DVD recording medium. Note that the following description refers to a movie as the 
multimedia title being processed, but it will be obvious that the invention shall not be so limited. 

Supplying a single movie in a format enabling the movie to be used in plural different cultural regions or countries 

25 requires the script to be recorded in the various languages used in those regions or countries. It may even necessitate 
editing the content to conform to the mores and moral expectations of different cultures. Even using such a large-capac- 
ity storage system as the DVD system, however, it is necessary to reduce the bit rate, and therefore the image quality, 
if plural full-length titles edited from a single common source title are recorded to a single disk. This problem can be 
solved by recording the common parts of plural titles only once, and recording the segments different in each title for 

30 each different title only This method makes it possible to record plural titles for different countries or cultures to a single 
optical disk without reducing the bit rate, ard, therefore, retaining high image quality. 

As shown in Fig. 21 , the titles recorded to a single optica! disk contain basic scene periods of scenes common to 
all scenarios, and multi-scene periods containing scenes specific to certain scenarios, to provide parental lock control 
and multi-angle scene control functions. 

35 In the case of the parental lock control function, titles containing sex scenes, violent scenes, or other scenes 
deemed unsuitable for children, i.e., so-called "adult scenes." are recorded with a combination of common scenes, adult 
scenes, and children's scenes. These title streams are achieved by arraying the adult and children's scenes to multi- 
scene periods between the common basic scene periods. 

Multi-angle control can be achieved in a conventional single-angle title by recording plural multimedia scenes 

40 obtained by recording the subjects from the desired plural camera angles to the multi-scene periods arrayed between 
the common basic scene periods. Note, however, that while these plural scenes are descritjed here as scenes recorded 
from different camera angles (positions), it will be obvious that the scenes may be recorded from the same camera 
angle but at different times, data generated by computer graphics, or other video data. 

When data Is shared between different scenarios of a single title, it is obviously necessary to move the laser beam 

45 LS from the common scene data to the non-common scene data during reproduction, i.e., to move the optical pickup to 
a different position on the DVD recording medium RC1 . The problem here is that the time required to move the optical 
pickup makes it difficult to continue reproduction without creating breaks in the audio or video, i.e., to sustain seamless 
reproduction. This problem can be theoretically solved by providing a track buffer (stream buffer 2400) to delay data out- 
put an amount equivalent to the worst access time. In general, data recorded to an optical disk is read by the optical 

so pickup, appropriately processed, and temporarily stored to the track buffer The stored data is subsequently decoded 
and reproduced as video or audio data. 

Specific Problem in Interleaving 

55 The operation of the stream buffer 2400, or a track buffer, in this DVD system is described brief ly below. 

Because rotational speed control of the optica! disk drive cannot instantaneously adjust the disk speed, the Input 
to the stream buffer 2400. i.e., the transfer rate Vr from the optical disK is a basically constant rate. Output from the track 
buffer, i.e., the transfer rate Vo to the decoder, however, varies according to the image quality, user intent, and even the 
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data can be contin^SiLly r^^cSScS ' S ' '"^"'"9 ^""^ W-^e to a time whereby 



L1=Vr-Vo 

r2] 



tinue without date interruptions. This time at whTcii the Tead-nrh^ad ^06^l^n7^n^ZZV^'^ 
a) The buffer is too small relative to the decoding speed of the decoder 

When the reproducing apparatus of the digital video disk system is configured with a disk read rate of 1 1 Mbps. a 
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maximum AV data compression rate of 10 Mbps. and a track lauffer (stream buHer 2400) capacity of 4 Mbits. for exam- 
ple, a data underflow state will occur. To prevent this data underflow state from occurring during the jump period Tj In a 
reproduction apparatus thus configured wrth slight overflow control maintained during normal continuous playback a 
maximum jump-enabled time of 400 msec can be assured even in a worst-case scenario where 10 Mbps of AV data is 
5 reproduced during the jump period. 

Note that a jump-enabled time of 400 msec is a realistic value that can be achieved in actual reproduction appara- 
tuses. In such an apparatus the distance that can be jumped during a 400 msec period is approximately 500 tracks It 
follows that the jump-enabled time can also be defined in data quantity terms, specifically the volume of the sequential 
data stream that the reading head 2006 can move through within the jump-enabled time. The data volume equivalent 

10 to a 400 msec jump-enabled time is approximately 250 Mbits. It will also be obvious that the actual distance in sector 
and track units on the recording medium can also be easily obtained from the data volume defined as the jumpable dis- 
tance based on the recording method and density of the recording medium. 

A 250-Mbit jumpable distance is equivalent to a 50 sec. presentation time assuming AV data reproduced at an aver- 
age 5 Mbits/sec. With even higher quality AV data, the presentation time is less than 50 sec. In movies and other data 

IS streams edited to remove particular scenes due to cultural, educational, or other reasons, the excised scenes are typi- 
cally long, usually ranging from 2 to 5 minutes, and even as long as 10 minutes. If the excised scene lasts 5 minutes 
for example, with the above reproduction apparatus, it is not possible to uninterruptedly connect the scenes before and 
after an excised scene if the before scene, excised scene, and after scene are recoided to disk in a single contiguous 
senes. More specifically, the data corresponding to a continuous 5 minute scene cannot be jumped in a single iumo 

20 operation. » j 

There are also cases in which the AV data compression rate. i.e.. the consumption rate Vo of data from the track 
buffer, approaches 1 0 Mbps and non-occurrence of a buffer underflow state cannot be assured, even when the excised 
scene data is jumped using a jump period Tj exceeding 400 msec. While such a data underflow state can conceivably 
be avoided by recording two AV data scenarios, i.e., excised (edited) and un-excised (unedited) scenarios, to disK this 
25 method does not make effective use of the available disk capacity. If it is also necessary to record duplicate data for 
much presentation time, the AV data will be low quality and it will be difficult to satisfy most user expectations 

The concept of shanng data between plural titles is described below with reference to Fig. 33 wherein TL1 and TL2 
refer to the data content of a first and second title, respectively. Specifically, the first title TLl consists of data DbA DbB 
and DbD reproduced contiguously during time T and the second title TL2 similarly consists of data DbA DbC and DbD 
reproduced contiguously during time T. Note that data DbA, DbB, DbC, and DbD are video objects VOB wHh display 
times T1. T2, T2, and T3, respectively. When two titles TLl and TL2 thus comprised are recorded to disk, the data 
stream is structured with data DbA and DbD as shared data of both titles TLl and Tl^. and data DbB and DbC as the 
discrete data of titles TLl and TL2, respectively, selectively reproduced during selection period T2 as shown by title 
TL1_2. Note that while there appears to be a time gap between the data Wocte in Fig. 33. this is simply to facilitate the 
use of arrows in the figure for easier description of the data reproduction paths. There is no actual time gap during play- 

03CK. 

The forniat whereby these data blocks DbA, DbB, DbC, and DbD are recorded to disk in title TL1_2 to enable con- 
tiguous reproduction of the data is shown in Fig. 34. In principle, data blocks DbA, DbB, DbC, and DbD composing a 
single contiguous title are recorded to contiguous segments of the data recording track TR (Fig. 9). Thus data DbA 
DbB, and DbD of first title TLl are first recorded contiguously, and are followed by data DbC unique to the Second title 
TL2. With this data format, the first title TLl can be contiguously reproduced without breaks in the title content i e 
seamlessly, by means of controlling the reading head 2006 to access data DbA. DbB. and DbD synchronized to 'olav- 
t)ack periods T1 . T2. and T3, respectively. 

To reproduce the second title TL2. however, the reading head 2006 must jump past data DbB and DbD after repro- 
ducing data DbA in period T1 . and must reach data DbC before the start of period T2 as shown by arrow Sq2a in Rg 
34. Then after reproducing data DbC, the reading head 2006 must jump back to data units DbC and DbD as shown by 
arrow Sq2b, and reach data DbD before the start of period T3. Because of the time required to move the reading head 
2006 between data blocks, it is not possible to assure seamless r^roduction between data DbA and DbC and between 
DbC and DbD, unless the distance ti-aveled between these data blocks requires less time than the time required for a 
so data underflow state to occur in the stream buffer 2400. 

Definition of Interieaving 

To thus enable the user to selectively excise scenes and choose from among plural scenes, a state wherein non- 
55 selected scene data is recorded inserted between common scene data and selective scene data necessarily occurs 
because the data units associated with individual scenes are contiguously recorded to the recording tracks of the 
recording medium. If data is then read in the recorded sequence, non-selected scene data must be accessed before 
accessing and decoding the selected scene data, and seamless connections with the selected scene is difficult. The 
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data underflow state does n5 ^curjfs 1^^^^ recorded to d.sk within the jumping range whereby an 

mittently accessing an^Vcti^gle "'^^^ ^^"^^ interruptions by inter- 

reproduction is thereby assured ^""^ "^'"^ tt^^^^ split data units. Seamless data 
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(outputtothedecodeoZ'throf^'^^^^^ 

state even after multiple repetitions of ms^T^TZ^^lT^-^ L^^ 1^ '^^"^ "^^^^ ^° ^'^^ « ^ata underflow 
distributed at an appropri Je irterval ThL mSS^ ^ '^^'"^ ^'"'"^ °* "^^^ each scene are 

"interleaving/ the^iSunS% a sileJ^^^ to assure seamless data reproduction is called 

interleave unrts afte? interleaving Se XTSavi ^te '^"^ " ^"^ 

scene are sepamted by one or more irtiSurStTlLV^^^^^^ ''^'°"9'"9 the selected 
t^.be.een.o.m.base..^^^^^^ 

secto7mre:;re'SS?heT;«ciVp12;^^^^^^ "^"^ ^ '^"^'^ ^--^^-9 -edium. If this 10.000- 

mined from the diffe encTt^SLSn tS^^^^^^^ '"♦«'^««^«' «-VU can be deter- 

buffer. Let us assume, for e^e. ^at^n^i^s^ d'a4ls be^^ "^'V ^"'^ °* ^'^^ 

Vr of 1 1 Mbps and an output transfer rate 3^ Mh^^^^ ^if ^ '^^^ "^'"^ ^ *"P"* ^"sfer rate 

interleaved Jnits ILVU is VS OoVs^^T^em m!JS^^^^^^^^ r^l ""2'' °* ^ »^«^«en 
mu,ate«,ereina260..sece.rat^rpr^^^^^^^^ 

moJnXelt™i!rnt1S^^^^^^^^ 

between transfer rates Vr and Vo (= 2080 Sl^br^.^ T^I ^^'^^ di^^rence 

recoiling medium M to store suSicierrt dbtaS^SI S^b^SS ^L"?^^ *° fr^'" 
optical pickup is moving to ihei^g^i^^^^^fi^J^^^^ 

accumulation read time 'nterleaved unit ILVU and can resume data reading is defined as the minimum 

presi^:tr::^2s^i;;ir^^^^^^^^^^^^ 

entation time intervals less than Ssec bl^een imeri«^^^^ Presentation time of 0. 96 sec. or greater with pres- 
the minimum accumulation read Smfcan be ^^"^ ^^^-V^ bit rate, 

pos^Wetoincreasethejumpat^etmewith'^^^^^^ 

nectS^rsS;? D s"en": A^con^l^^ 'S 'h """^ '""""'"^ -^"-'^ P^-^e: scene A con- 

scene A connecteci to scene C wTiSTs^ Sariy si^^S'^rS ' ^ 
time segment than scene B. In such VaLeHSnrDlTf^Sr w r^Z ""^ ^""^"^ °* D but for a different 
3. The system stream corresponSg t?Sen2 B D 1 ^L nT'^.T ^^^""^"^ ^'^ ■ ^-2. and D- 

Vo (= 8 Mbps). Data is inputSthe Skb^e" m frans^r ra^^^^ ^^^^1''"'"" ^ '^'^ 

ing and appending scene D-2 to scene c nf Fin -T^ thl-K J. ^ accomplished as shown in Fig. 36 by copy- 
c»n„ec„, scenes ^ ..e cw« «,o d*. e^., ^r^™eS."S?erC« S 
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points thereof aligned. 

The interleaving concept is described in further detail below. 

The audio-video (AV) system stream described above is one example of interleaving with time information. This 
interleaving method arrays audio and video information having the same time-base so that data input to the buffer at 

5 approximately the same time is in physical proxiodty, ar^ data units having approximately the same presentation time 
are arrayed in attemating sequence. When one scene can be replaced with another scene In titles such as movies, 
however, the time between these plural scenes often differs. When the AV system stream interleaving method 
described above is applied in such cases, the between-scene time difference can be absorbed by the buffer if it is within 
the jumpable time. If the between-scene time difference is greater than the jumpable time, however, the buffer cannot 
'10 absorb the difference and seamless playback is not possible. 

If the track buffer size is increased to increase the amount of data that can be accumulated at one time, a longer 
jumpable time is obtained, and the interleave unit and sequence are more easily determined. When interactive opera- 
tion enabling the user to select from among plural scenes (e.g., multi-angle scenes) with seamless playback, the pres- 
entation time of tiie previous angle stream is increased after the angle (stream) is changed if the interleaved units ILVU 

15 are made longer and the amount of data stored at one time is increased. This also results in more time being required 
for the displayed sti-eam to change. 

Interleaving is thus the process of optimizing tiie system sfream arrangement in data block units to prevent a data 
underflow state from occurring in tiie track buffer of tiie authoring decoder DC when the encoded data supplied from 
the stream source is consumed for decoding by the decoder. 

20 A major cause of this data underflow state is tiie mechanical movement of the optical pickup, though tfiere are 
lesser factors such as the decoding speed of the communications (decoding) system. Mechanical movement of tiie 
optical pickup is a problem when tiie optical pickup scans the data recording track TR of the optical disk M to read data. 
Interleaving is also needed when recording the data to tiie data recording track TR of the optical disk M. The decxxiing 
speed of the communications system can also become a problem when the source stream is supplied directly as occurs 

25 witii live broadcasts, cable television and otiier dedicated line transmissions, broadcast satellites and otiier radio wave 
transmissions, and other means whereby titie content is not reproduced from a recording medium on tiie user's side. In 
such cases the transmitted source stream must be interleaved. 

Interleaving can tiius be more specifically defined as the process whereby the data carried in a source stream com- 
prising source data groups of plural contiguously input source data blocks is arranged in a particular sequence whereby 

30 tiie desired (targeted) source data can be intermittentiy and sequentially accessed to contiguously reproduce tiie infor- 
mation in tiie targeted source data. The duration of these intermittent breaks in the input of the target source data tiiat 
is to be reproduced is therefore defined as the junp time of the interleave control. 

It should be noted, however, that an interleaving method for arraying on a random access disk movies and other 
common titles containing scene selections that may branch and recombine according to various scenarios in a manner 

35 whereby video objects VOB containing video data compressed with variable length coding fias not been described. 
When arraying this type of data to disk, a certain amount of trial and error is required using the compressed data. This 
obviously makes it necessary to define an interleaving method for arranging plural video objects in a sequence enabling 
seamless playt^ck. 

When applied to a DVD system as described above, these video objects are dist-ibuted to positions (navigation 
40 packs NV) within a specific time-base range bounded by GOP units, ttie unit of video data compression. The GOP data 
length, however, may vary as a result of user-defined image manipulation processes or intra-frame coding inserted for 
higher image quality. This means that the location of the management packs (navigation packs NV). which are depend- 
ent upon tiie presentation time, can vary. This means that the point at which the scene angle changes or the optical 
pickup jumps to tiie next data block in the playfe>ack sequence is indefinite. Furthermore, if plural scene angles are inter- 
45 leaved together, ttie length of contiguously read data is Indefinite even if tiie next jump point Is known. Thus, tfie data 
end point position is known only after tiie next angle data is read, and switching the playback data is thus delayed. 

The present invention therefore provides a method and apparatus enabling seamless data reproduction using an 
optical disk having a data structure whereby data is shar^l between plural titles to efficientiy utilize the available optical 
disk space, and a new function called "multi-angle scene reproduction" is achieved. The method and apparatus of tiie 
50 present invention are desaibed below witii reference to tiie accompanying f igures. 

intgrieaved WopH and Interleave unit 

The interleaving method enabling seamier data reproduction according to the present invention is descritted 
55 below witii reference to Fig. 24 and Fig. 37. Shown in Fig. 24 is a case from which tiiree scenarios may be derived, i.e. , 
branching from one video object VOB-A to one of plural video objects VOB-B, VOB-C, and VOB-D, and then merging 
back again to a single video object VOB-E. The actual arrangement of these blocks recorded to a data recording track 
TR on disk is shown in Fig. 37. 
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in onS^r ^ • ^"^ independent playback start and end times and are 

C «1 VOR *? ^ '^'9- *e playback st^ and e^ S^Tvol^B VOB 

il^JS w r aligned during interleaving. The interleaved data blocks are then reco«lSto dS to a^iguo^ 

ttxte a™ anwd as a,o»n in 38 In the pMa* s«,u«,ce, i..! block 1 , iL* 2. wLS^^S*? 
-one a^a^ t L*?."? «^"BS (VrSTT.VOBS) oon*.o. Wocks , . 7, Irid^ 'Biock^N. VOB , 
a 3. 5. «« 7 similarly <l««s^, coraalnVOBS2,3,6.and,0.BlocKs2,3.5,ana7.«»usconll(Zs 

mSStn^Ji! d|g«al v*o disk Mo«, spsofflcany. this posltk», irto„S«on Is Z aSSSS 

k 15 likewise divided into four interleaved units ILVUmI ILVUm2 ILVUiiia anri ii vumflTSl*^^^^ 

s^orrirs:i:i-r;^=^:S^^^ 

I. V/. . ^,!^'f '"terleaved units ILVUkI , ILVUkS. ILVUk3. and ILVUk4 and ILVUmI ILVUmP 

i'^«srr,:zrts^„sso^-;2^aS:s^Tr^ 

An altemative for aRhim /ina Jntarlaauinp 

Seamless reproduction is even possible when there are three possible scenario threads as shown in Rn ■ « 

TtJT,"""^ S ^"^""^ °* that this prSe^ S 2^to ^tan^e 

starting and end poinis makes rt possible to seamlessly rep«)duce even compliLted threadin^^dSeTer^ SetS 

An interleavina algorithm t ^ mpatibte with variable langth cMderi dat a 

^ J\n example of an interleaving algorithm compatible with variable length coded data. i.e.. videodata. is described 
raS™l=~'^^ 
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When data is interleaved, the interleaved units ILVU forming separate video objects VOB are alternatelv arraved If 

re"n'cth or'if'Sitt;'TH T'*? 'T' ^T"^ '° the nnNlSrteavfun 

length, or if the total length of plural interleave units in any but the shortest of plural VOB. is greater than the shortest 
.nterieave distance, an underflow state v«ll occur when this shortest ir,terleave VOB is re^roduc^ anTnorsearS 
reproduction will result instead of seamless reproduction. ""ucea. ana non seamless 

y^^^'^.^!^^^ '^'^ P'®^®"* embodiment it is therefore detemiined whether interleaving is possible 
^i^'n'^^I^^Z^K' "rn"?'' '^"^^^ °* pre-encoded streams. Sc^Sse Se SfeS 

of interi^ving can thus be determined in advance, the need fordata reprocessing, i.e.. the need to adjust the interieav^ 
ing conditions and record after interleaving and encoding are once completed, ran be prevented 
K.i„'^!.'"I®''®*!Iu^«I" u!'"' '^^^'^'"S to optica' disk according to the present invention is described specifically 
^h^l"!^;:!""* 'TJ'I^ "r^"^ ^"^^ pertdrmance and other conditions of the reprodu^^dTsk 
Vo i.TJn2« ^ buff«^ input transfer rate Vr and output transfer rate 

Vo IS defined as Vr > Vo as previously described. The maximum bit rate of each VOB to be interleaved is therefore set 

irin ™i!^^^'r°J^ determining whether interleaving enabling seamless reproduction is possible it is ass^mS 
T *° ^ '"terleaved are encoded with constant bit rate (CBR) coding at the maximum bit rate the int^^ 

eave unrt data volume is maximized, the time that can be reproduced from the date volumeTaTMn be p acei r^^^ 
jumpable distance is shortened, and the interleave conditions are stringent 

Note that it is assumed below that each VOB is encoded with constent bit rate (CBR) coding at the maximum bit 

iumrfi^i^iTif^ ^-^ description of the reproduction apparatus that the distance the optical pickup can 

S it '""^ expressed as a date quantity is jumpable distance JM. and the input date bit rate to the 

tradt buffer of the reproduction apparatus is BIT. >=uiiieti«iuuie 

Mhif 'i?. * °* ^" ^'^! !?P"^"**°" apparatus, the disk jump time JT is 400 msec, the jumpable distance JM is 250 
Mb^ in this jump time JT The maximum bit rate B of the VOB in the MPEG system is def ined^s 8.8 Mbps cc^siiering 
that an arerage 6 Mbps is required to obtain image quality superior to that of a conventional VCR recording 

Based on the jumpable distance JM. jump time JT and data read times from disk, the target values for the smallest 
irter eaved unit size ILVUM and the smallest interleave unit presentation time ILVUMT^ are calculaTeSS The 

ILV UMT S: JT + ILV UM/BIT f3j 
ILVUMTxB = ILVUM r^i 

35 W 

GOp'^W^^S' CM iftv ^MK? S^'T! 'LVUMT is determined to be 2 sec, and the smallest 

GOPblockdateGMis17.6Mbrt. Thus, rf the smallest interleave unit, which is the smallest unit of the date layout isa 

'eqtfi^rrrdr^^rtorior'^^^^^^^^ 

wITch ZTl ^' ^''^.S presentation time, the total preser^tion timeTS 

I^l H^fn ^ " T^^.'""^ be shorter than the time that can be reproduced within the interleave dis- 

?™ iMT^r. T"^ example the jumpable distance JM is 250 Mbit and the maximum VOB bit rate is 8.8 Mbps ttie 
tme JMT ihat can be reproduced with the date quantity read within the jumpable distent JM is 28.4 sec. tt is tfSi pos 
S dl d^i^itr '""^'^^^ ^^^'^ eq"^o" "Sing these values. If each VOB in the interleaid b^Te^S, 
ohS^c^fTm I sanrie number of interleaved block and this number of interleaved divisions is v. equation 5 can be 
obtained from the conditions of the smallest interleave unit length. 

(presentation time of shortest VOB)/l LV UMT s v 
Equation 6 can then also be obtained from the jumpable presentation time conditions. 

V 5 (presentation time of all VOB except shortest VOB)/JMT (6] > 

tinn frlrJ interleaved if the above conditions are fulfilled. In practical temis. VOBU compensa- 

IT™ H '^ ^'^ ^'^'^'"^ ^ ^^^y interleave units are iS^ 

rth^^riS^T ^"^'^"^ 2. 3, and 4. It is necessary to add the maximum VOBU time (1 0 Sc^ 

to the smallest mterleave unit presentation time ILVUMT. and reduce the presentation time in the interleave distance 
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JMT by the maximum VOBU time. 



Multi-scene npntrol 



Parental contml 



An exanple of a multi-rated title stream providing tor parental lock confr^^ 
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scenes- containrng sex. violence, or other scenes deemed unsuitable for children are contained in a title implementing 
parental lock control, the title stream is recorded with a combination of common system streams SSa, SSb and Sse 
an adult-oriented system stream SSc containing the adult scenes, and a child-oriented system stream SSd containing 
only the scenes suitable for children. Title streanns such as this are recorded as a multi-scene system stream containing 
the adult-oriented system stream Ssc and the child-oriented system stream Ssd anayed to the multi-scene period 
between common system streams Ssb and Sse. 

The relationship between each of the component titles and the system stream recoided to the program chain PGC 
of a title stream thus comprised is described below. 

.The adult-oriented title program chain PGCl comprises in .sequence the common system streams Ssa and Ssb 
frie. adult-oriented system stream Ssc,. and the common system, stream Sse. The chBd-oriented title program chairi 
PGC2 comprises in sequence the common system streams Ssa and Ssb. the child-oriented system stream Ssd and 
the common system stream Sse. 

By thus araying the adult-oriented system stream Ssc and child-oriented system stream Ssd to a multi-scene 
period, the decoding method previously described can reproduce the title containing adult-oriented content by repro- 
ducing the common system streams Ssa and Ssb. then selecting and reproducing the adult-oriented system stream 
^c and then reproducing the common system stream Sse as instructed by the adult-oriented title program chain 
PGCl. By altematively following the child-oriented title program chain PGC2 and selecting the child-oriented system 
stream Ssd in the multi-scene period, a child-oriented title from which the adult-oriented scenes have been exouroated 
can be reproduced. ^ 

This method of providing in the title stream a multi-scene period containing plural alternative scenes, selecting 
which of the scenes in the multi-scene period are to be reproduced before playback begins, and generating plural titles 
containing essentially the same title content but different scenes in part, is called parental lock control 

Note that parental lock control is so named because of the perceived need to protect children from undesirable con- 
tent. From the perspective of system stream processing, however, parental lock control is a technology for statically 
generating different title streams by means of the user pre-selecting spedfic scenes from a multi-scene period Note 
further, that this contrasts with multi-angle scene control, which is a technology for dynamically changing the content of 
a single title by means of the user selecting scenes from the multi-scene period freely and in real-time during title play- 

This parental tock control technology can also be used to enable title stream editing such as when making the 
director-s cut. The director s cut refers to the process of editing certain scenes from a movie to, for example shorten the 
total presentaton time. This may be necessary, for example, to edit a feature-length movie for viewing on an airplane 
where the presentation time is too tong for viewing within the flight time or certain content may not be acceptable The 
movie director thus determines which scenes may be cut to shorten the movie. The title can then be recorded with both 
a full-length, unedited system stream and an edHed system stream in which the edited scenes are recorted to multi- 
scene penods. At the transition from one system stream to another system stream in such applications parental lock 
control must be able to maintain smooth playback image output More specifically, seamless data reproduction whereby 
a data underflow state does not occur in the audio, video, or other buffers, and seamless information reproduction 
whereby no unnatural inten-uptions are audibly or visibly perceived in ttie audfo and video playback, are necessary 

40 Multi-angle cnntrf^l 

The concept of multi-angle scene conf ol in the present invention is described next with reference to Fig 44 In gen- 
eral, multimedia tities are obtained by recording both the audio and video information (collectively "recording" below) of 
the subject over time T The angled scene blocks #SC1. #SM1, #SM2. #SM3, and #SC3 represent the multimedia 
^* recording unit times T1 . T2, and T3 by recording the subject at respective camera angles. Scenes 
#SM1 #SM2, and #SM3 are recorded at mutually different (first, second, and third) camera angles during recording unit 
time T2, and are referenced below as the first, second, and tiiird angled scenes. 

Note that ttie multi-scene periods referenced herein are basically assumed to comprise scenes recorcied from dif- 
ferent angles. The scenes may, however, be recorded from the same angle but at different times, or they may be com- 
puter graphics data. The multi-angle scene periods are thus the multi-scene periods from which plural scenes can be 
selected for presentation in tiie same time period, whether or not the scenes are actually recoided at different camera 
angles. 

Scenes #SC1 and #SC3 are scenes recorded at ttie same common camera angle during recording unit times T1 
and T3, i.e.. before and after the multi-angle scenes. These scenes are therefore called "common angle scenes " Note 
that one of the multiple camera angles used in the multi-angle scenes is usually ttie same as ttie common camera 
angle. 

To understand the relationship between these various angled scenes, multi-angle scene control is described below 
using a live broadcast of a basetiall game for example only. 
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The common angle scenes #SC1 and #SC3 are recorded at the common camera angle, which is here defined as 
the view from center field on the axis through the pitcher, batter, and catcher. 

The first angled scene #SM1 is recorded at the first muKi-camera angle, i.e.. the camera angle from the Ijackstop 
on the axis trough the catcher, pitcher, and batter. The second angled scene #SM2 is recorded at the second multi- 
carnera «"9le. Le the view from center field on the axis through the pitcher, batter, and catcher. Note ttiat the second 
angled scene #SM2 rs ttius the same as the common camera angle in this example. It therefore follows that the second 
angled scene #SM2 .s the same as the common angle scene #SC2 recorded during recording unit time T2. The third 
the SeW^"^ * multi-camera angle, i.e.. the camera angle from the backstop focusing on 

JT* "'^fl"^*? °* ^"^'^ ^'^^"^ • o^r'aP recording unit time T2- this 

^Q^"? ^? . multo-angle scene period." By freely selecting one of the multiple angle scenes #SMl . #SM2. and 
#SM3 in this multi-angte scene period, the viewer is able to change his or her virtual viewing position to enjoy a different 
view of the game as though the actual camera angle is changed. Note that while there appears to be a time gap 
between common angle scenes #SC1 and #SC3 and the multiple angle scenes #SM1 . #SM2. and #SM3 in Fig 44 Sis 
Llf T 5.^°''*f ® ^^"^ °^ ^""^ *" ^'Sure for easier description of the data reproduction paths reproduc^ by 
selectng different angled scenes. There is no actual time gap during playback. 

Fin ^t^^^ f "^^"^ °" P'^®"* « described next with reference to 

Sr^L!? *® P^^^^e °* connecting data blocks. The multimedia data corresponding to common angle scene 
#SC IS referencol as common angle data BA. and the common angle data BA in recording unit times T1 and T3 are 
SSr!.!2. i • '^^^^^y- ^« "^timedia data coiresponding to the multiple angle scenes #SM1 , 

#SM2, and ^M3 are referenced as first, second, and thiid angle scene data MAI. MA2. and MAS. As previously 
described wrth reference to Fig. 44, scenes from the desired angled can be viewed by selecting one of the multiple 

VI ""■'^I'^^V f."? ^""^^ "° 9«P common angle date BAl and sT^^d 

the multiple angle data units MAI . MA2, and MA3. » w 

KoJLr!.°^®^^"J^^^° ^^^"^ '"terrrtttent breaks in the playback information can result 

S^hlir/nZ'f ^"^'""'**P'« «"9'« """s depending upon the content of the data at the connec- 

tion between the selected multple angle data unit MAI , MA2, and MAS and the common angle data BA {either the first 
common angle data BA1 before the angle selected in the multi-angle scene period or the common angle data BA3 fol- 
'''If "9le selected in the multi-angle scene period). The result in this case is that the title stream is not rraturally 
rSSuSnTes^ute "^^^ '^'^ reproduction is achieved but non-seamless information 

"li*"!!?'^ selection process whereby one of plural scenes is selectively reproduced from the multi-angle 
scene period with seamless information presentation to the scenes before and after is described below with applicatfon 
in a digital video disk system using Fig. 23. 

. . ^J"^'"^ scene-angle, i.e., selecting one of the multiple angle data units MAI , MA2. and MAS, must be com- 
f *!?® preceding common angle data BA1 is completed. It is extremely difficult, for example, 
to change to a drfferent angle data unit MA2 during reproduction of common angle data BA1. This is because the ™h 
tomedia data has a variable length coded MPEG data structure, which makes it difficult to find the data break points 
(boundaries) in the selected data blocks. The video may also be disrupted when the angle is changed because inter- 
franre corre ations are used in the coding process. The group_of_pictures GOP processing unit of the MPEG standard 

^^J^ J^^r^^^ ^ ^ "^"^ processing not referencing frames belonging to another GOP is possi- 

ble within this GOP processing unit 

n»ri^ "fl^'JIT*!' f ^I'^Tf ®- °- reproduction reaches the multi-angle scene 

perioOand at the latest by the time reproduction of the preceding common angle data BA1 is completed, the angle data 
selected from within the multi-angle scene period can be seamlessly reproduced. However. H is extremely difficult while 
LThf f ^^'"'^^'y reproduce another angle within the same multi-angle scene period It 

IS therefore difficult when in a multi-angle scene period to dynamically select a different angle unit presenting, for exam- 
ple, a view from a different camera angle, a. 
Y^i^lJUT^ °* w«Wiing brtween scene angles within a muHi-angle scene period is described in further detail 
below Witt, reference to Rg. 76. Fig. 77. and Fig. 45 based on the digital video disk data structure described above 
MA, M AO presentation times of the smallest angle switching units in each of the multiple angle data units 

mJ • ^T^' T "l^:^: '^'9'^' ^"^^ ^y^^' "^^^^^ data units 

MAI. MA2. and MAS are the titi^ edrting units, i.e.. the video objects VOB. Each multiple angle data unrt (VOB) com- 
prises plural (three in this example) interieave units ILVU as ttie smallest possible angle switching unit Nrte ttiat each 
S^^aSI a^^" ^ '^'""^ °* ^"^'^ "^^^ coSains arSe ^chlSg 

The angle switching units A51 . A52. and ASS of the first angle data MAI have presentation times of 1 . 2. and 3 sec- 
onds, respectively, resulting in the first angle data MAI having a total presentation time of 6 sec. The second angle data 
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MA2 similarly comprises angle switching units B51 . B52, and B53 with presentation times of 2, 3. and 1 second, respec- 
tively, and the third angle data MA3 comprises angle switching units C51 , C52, and C53 with presentation times of 3, 
1 , and 2 seconds, respectively. It should be noted that while the angle data MA1 , MA2, and MAS each has a 6 sec. pres- 
entation time, the presentation time can obviously be set to various other particular values. 

5 The following example describes switching to and beginning the presentation of another (next) angle view while 

reproducing any particular interleave unit. For example, if the angle is changed from first angle data MA1 to second 
angle data MA2 while reproducing interleave unit A51. reproduction of interleave unit A51 stops and reproduction of the 
second interleave unit B52 in the selected second angle data MA2 starts. This change intermits both the audio and 
video presentation, resulting in non-seamless information presentation. 

10 Likewise, if the user chooses to switch to the scene conresponding to the third angle data MA3 during reproduction 
of the second interleave unit B52 in the second angle data MA2, reproduction of interleave unit B52 stops and repro- 
duction of interleave unit C53 starts. This operation again intermits both the audio and video presentation, resulting in 
non-seamless information presentation. 

Note that in the above cases switching between multiple angle data during data reproduction stops reproduction of 

15 the angle being presented, and seamless information presentation, i.e.. presentation without intermitting the audio and 
video, does not occur. 

The method of switching the angle after completing interleave unit presentation is described below. 
If the user selects second angle data MA2 during reproduction of interleave unit A51 in first angle data MA1 . for 
example, the second interleave unit 852 in the second angle data MA2 is selected from the point reproduction of inter- 
20 leave unit A51 with a presentation time of 1 sec. is completed. Because the start of interleave unit B52 is 2 sec. from 
the beginning of the multi-angle scene period, there is a gap between the end of interleave unit A51 reproduction at 1 
sec. into the multi-angle scene period and the beginning of interleave unit B52 at 2 sec. into the multi-angle scene 
period, and there is therefore no time-base contiguity in reproduction. More specifically, because there is no continuity 
in the audio, the audio cannot be seamlessly reproduced. 
25 A Similar scenario results if the user then switches to the angle scene corresponding to the third angle data MAS 
during reproduction of the second interleave unit B52 in the selected second angle data MA2. i.e.. interleave unit C53 
is switched to after reproduction of interleave unit B52 is completed. In this case the completion of interleave unit B52 
reproduction is at 5 sec. from the beginning of the multi-angle scene period, the beginning of interleave unit CSS is at 4 
sec. from the beginning of the multi-angle scene period, and there is again no time-base contiguity. The connection 
30 between the audio and video components of the interleave units B52 and C53 is also not good. 

It is therefore necessary for the interleave units of each angle to have the same reproduction time and contain the 
same number of video frames in order to achieve seamless information switching between multiple angles. 

The internal structure of the interleave units is shown in further detail in Fig. 77. As shown in Fig. 77, each of the 
interleave units ILVUbl , ILVUb2. ILVUd . and lLVUc2 contains interleaved audio and video packets, indicated as A and 
35 V, respectively. 

In general, the data size and presentation time of each audio packet A is the same. In this example, interleave units 
ILVUbl , ILVUb2, ILVUd , and ILVUc2 respectively contain 3, 2. 2. and 3 audio packets. Therefore, angle data MAB and 
MAC each contain 5 audio packets and 13 video packets in multi-angle scene period T2. 

Angle switching control within a multi-angle scene period comprising a multi-angle system stream (VOB) with this 
40 packet structure is described below. 

If the angle is switched from interleaved unit ILVUbl to interleaved unit !LVUc2. for example, the total number of 
audio packets in friese two interleave units ILVUbl and ILVUc2 is 6. which is one more tiian the specified total number 
of 5 audio packets in this multi-angle scene period T2, This would therefore result in an overlap of one audio packet in 
tfie reproduced audio if tiiese two ILVU were connected and reproduced. Ukwise, if tiie angle is changed between the 
45 two interleaved units ILVUd and ILVUb2 containing only two audio packets each, the total of 4 audio packets is one 
less tiian the specified total number of 5 audio packets in this multi-angle scene period T2. Connecting and reproducing 
tfiese two interleaved units would therefore result in an audio packet shortage, and a break in the audio equal to ttie 
duration of one audio packet. It is therefore dear tiiat when the number of audio packets in the connected interleaved 
units is not equal to the specified number of audio packets in that multi-angle scene period, the audio will not be satis- 
50 factorily connected, and non-seamless information presentation containing noise and/or intermittent audio will result. 

Fig. 45 shows multi-angle scene control when tiie multi-angle data MAB and MAC shown in Fig. 77 contain different 
audio data. Common angle data BA1 and BA3 contain tiie common audio data of tiie common scenes before and after 
ttie multi-angle scene period. The first angle data MAB comprises first angle interleave unit audio data ILVUbl and 
ILVUb2, ttie smallest angle switching unit within tiie multi-angle scene period. The second angle data MAC likewise 
55 comprises second angle interieave unit audio data ILVUd and ILVUc2. 

Fig. 1 4 shows the audio waves resulting from the audio data recorded to the multi-angle data MAB and MAC witiiin 
multi-angle scene period T2. The contiguous audio output of angle data MAS is formed from the two interleaved unit 
audio data ILVUbl and ILVUb2. The contiguous audio output of angle data MAC is likewise formed from tiie two inter- 
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leaved unit audio data ILVUcI and ILVUc2. 

audb d'ate l!!rjbT rrjr H?"2?« of angle data MAC is switched to during reprcxluction of the first interleave unit 
SS^ri^LT r I ^ ^^h^ below. In this case reproduction of interleaved unit ILVUc2 occurs 

after reproducton of interleaved unit ILVUbl is completed. As a result, the audio wave resulting from these two inte^ 

non-contguous at tt^e angle switching point, and the audio connection is therefore not completely satisfacSry. 

If the audio data is encoded using Dolby AC-3 coding, the problems are even greater because AC-3 codino use 
ST™ i-S^Sr^?'""'? "='"9 time-base signal correlatLrr^u'cSon 
H H ? ? ^"^^ "^'""^ *° ^ data from one angle a^d 

swrtdn to the audio data of anotherangle during reproduction in a multi-angle scene period 

™«2rK^'^"r°^ "L* '""W-a^g'e scene period contains discrete audio data, the audio output may be inter- 
^sf nn^rrnH? ^"^'^ '^^^"S"^ °" =°"te"t ^he date in such 

SrSuc^diSil^t'° ^^T^Tl""^" reproduction, resulting even in iiritation or discomfort to L 

^nf. S .2 """-"'"tiB^rty *" the reproduced information content, and can therefore be 

m^s i Shi3 " °' intermittence. Seamless infom«tion presStion 

rtetel!li?i"*MiIo ^'^^Ki^f °' ^'^'^"B to the present invention is described next with reference to Rg. 46. Three angle 
data MAI. MA2. and MA3 are written to multi-angle scene period T2 in this example reeangie 
JS^ ""^'"^ ^"9'^ switching units All. A12. and A13 as the smallest possible ancle 

^^*.ng unrts. These angle switching units A51 . A52. and A53 have presentation times of 2. 1 , anS sVecon^s re^pei 

MA,^® ^^"^ ="9'®'*^ "^^2 similarly comprises angle switching units B1 1. B12. and B13. and the third angle data 

z=t^e\T2Ta:srsS^^ 

rpnr!!i!!!^!ifn Synchronized interleave units thus have the same presentation times, contiguous audio and video 
^oductK)n can be achieved without interruptions or overlaps at the angle switching position even whenlie user 
SrislreS"' '""^^ *° '^"'""^ '"^"^"^ presentation can tterefore be achievS Ts p?iT 

inn Jni^m^'^l^^'^T"^'^^*^'"' ^'^^ ^ the Bctual presentation times Of the Smallest angle 9«itch- 

Ziln ir^^ 'J """T '"^l™' «:ene period to the same times, the number of reprod^S, 
InH ^ interleave unrt must be the same. MPEG data compression normally operates on the QOP unS^Sel 

andtwo parameters defining the GOP structure are the M and N values. M is the I- ^ P^icture cycle and NisTe 
nun*er of frames contained in that GOR Furthermore, changing the M or N parameter sSting fr^^ently during Z 
enaxlmg process simply complicates MPEG video encoding control, and is not. therefore. norr^ally^onT 
the ^i2t°f nni^tlTw-^ data structure shown in Rg. 46. i.e.. a method of setting the actual presentation times of 

rirrer~^ncei:sr^^^^^^^^ 

««rh^noi! rt""^ > ^® """"^^ ^3'® ""ts MAB and MAC to the multi-angle scene period and 

^ '^'^^ .nterleaved units ILVUbl and ILVUb2. and ILVUcI and ILVUcl. respectively TOs^s 

for sunplicrty of discussion only Each interleaved unit is a GOP structure. The GOP structures in t^e^lti-angle scLne 
period set the M and N parameters of the synchronized mterieaved units ILVUbl and ILVUcI to theStrnL XeJInd 
sin^larly set the M and N parameters of the synchronized interleaved units ILVUb2 and ILVuL to theTr^e^^^ 

n d^~S « nnf"" T "^^T "^^^ -^^C. the presentation timSS the i^date 
n drfferent angles can be set to the same on the smallest angle switching unit level. Thus, when the angle is chanaS 

fromfirstangtedata MAB ILVUb2toangledata MAC ILVUC2. contiguous video presemationwithoJ^^ 

IS rime ' "^"^ ^''^"^^ ^^'"9 ""^"S betweenThLse Clvu 

sam?«^'S mL^'^^ setting the audio data presentation times on the smallest angle switching unit level to the 

1^,2 Suc1 fnlflTS^n'^'^^^^ '■"'"^"""^ *° ■''S- ^ "^'S- ^- '"terieJve units ILVUM 

ILVU^. ILVUcI , and ILyUc2 contain interleaved audio and video packets, indicated as A and V. respectively 

pnH I^! °r I ? Presentation times are normally constant. As also shown in the figure. ILVUbl 

^^Ji multi-angle scene period have the same number of audio packets (2), and ILVUb2 and ILVUc2 have 

he ?ame number of audio packets (3). By thus writing the same number of audio packets to the synchron^zSiZ! 
L^S^ «t f^'"^ ''''^ ^'^ Presentation'times can be sTiSe samf onTe 

I!"^ ^"^'^ angle dat^ MA^^d 

^hSvS?i^ T° P;^^™" ^'^^''"t audio intermittence or overlap at the angle switchir^ position ^^e 
achieved because the angle switching timing does not change. MH»uuiiu«ioe 

However, if each of the smallest angle switching units in the multi-angle scene period contain audio data describing 
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dLte rl^r^^ ^ "^^'^^ '^^^''"^^ '° ' 2) to a'^hieve corrtiguous audio 

aSoT^f nrlTn^r ^*i"9 POint by simply coding each smallest angle sv^ching unit (ILVU) with the same 

audio data presartafon tme. It .s possible to avoid intermitting the audio presentation, however, by writing the same 
(common) audio data to each angle within a multi-angle scene period on the smallest angle switching unit (ILVU) level 
' ll^l^Z ' ri'S!? • "^"i'^^' ''^^"^^on presentation can be achieved by arraying the data to assure corrtiguous 
mforma^n content before and after the connection points in the reproduced data, or by formatting the data in closed 
data units that are completely reproduced at the switching points. e aara m ciosea 

A further multi-angle scene period data stmcture in which common audio data is written to each different anale is 
^TZ '^- - Fig. 45. this data structure is achieved by wrrting audio dat^Thl^s 'com 

10 - Plate within each switching unit (interleaved unit ILVU) to the angle data MAB and MAC 

...Hi?^"^® audio data is thus complete within each interleaved unit ILVU, audio data producing a discorrtforting 
audo wave as a result of connecting different audio waves at the angle switching point ««H not result even when t^e 
angle IS changed by swrtching from first angle interleaved unit ILVUbl to second angle interleaved unit ILVUc2 within 
an encoded audio data multi-angle scene period thus structured. 

Note that ifthe audio data is formed with the same audio wave on the interleaved unit ILVU level, seamless infor- 
M\,U^ '^^ "^'^ """"^ "^^^ »^in each interleaved 

wh.;!tr«nl^"'*i,'^^t? "^'"^ ^^-^ """^^ ^""^''^^ correlations can be retained even 

n^Z K^"^' ^"'^ reproduction can be achieved at the angle switching point without 

no se or intermittence because common audio data is written to the smallest angle switching units (ILVU) of the angS 
data or IS complete within each interleaved unit ILVU. i^; o' me angie 

*h» thatthe present invention shall not be limited to only two or three types of angle data MA within 

Sr^th^dr^fn :nh":S^treIm' """""^'^ "^"^ ^^'"^ ^ '"''^ *° ""''^ e^end 

It Is therefore possible to achieve seamless information presentation as previously defined 
A ® °,^!If *f " °^ multi-angle control based on the digital video disk data structure is thus as described above 
«noic Tot •? "^^"^ multi-angle control data specifically enabling selection of a different 

angle data unit while reproducing one angle data unit in the same multi-angle scene period is. however, descried 

th/mM«- f Th"^ "iP.l'^f^^^^ ^^y^ *° « contiguous block region, the interleave unit data of 

me multi-angle data 1^1 MA2. and MA3 in the multi-angle scene period is arrayed to an interleaved block region Id 
tiie common angle data BA3 following thereafter is an-ayed to the next contiguous block region. Referenced t? he dTta 
structure shown in Fig. 16. the common angle data BA1 constitutes one cell, the multi-angle data MAI MA2 and MA3 
Z !5! ""T corresponding to the multi-angle data MAI . MA2, and MA3 constitute one cell block 

ind *t rSJ^f "Mfi" ''''' " "'"^ °* = "between fiist and la^t ceH? 

!lnf„^ 1 H ^ ''t" "'^ (cell block type CBT = angle)' 

^Tamltrnirr^L^ *° "^^ ^^l'-'^^" connectioTare also se?for 

seamless playback (seamless playback flag SPF = "seamless pla^ck") 

forr Ji^® '® fL*!! ^'^^"^ co^teinins a multi-angle scene period and the basics of the on-disk layout in the pre- 

ferr^ embod.rnent of the invention are shown in Fig. 47. The multi-angle scene period is a period in which the^rSm 
^n be freely changed by the user. In a stream with the sfructure shown in Rg. 47. it is poss^bleTo Si to VOB J^r 
VOB-D during reproduction of VOB-B. It is therefore likewise possible to switch to VOB-B or VOB-D during repySurton 
of VOB-C. and to switch to VOB-C or VOB-B during reproduction of VOB-D reproduction 

obte!^pS'iS^m"S "^^H?^' ?^ "!!!! K ' "^^"^ ^"9'^' ®- ^"9'® the smallest interleave unit 

'nformation is also added to the angle interleave unit A-ILVU. The navigation pack NV prwiouslv 
described corresponds to this A-ILVU management information. prwiousiy 

for nCliJ^tfnTJ! "^""^ ^""'^ ^'^^^^ ^^^^^s^ °* next A-ILVU are recorded 

for plural angles is shown as another embodiment of the invention in Fig. 48. While this figure is very similar to Hg 4? 

racrv^Brc2^Tns"^l^^^^^^^ T'^rT ""^^'^^ t»^« f^c^^ V oi 

VHRM ! ^"'^ P^** ^"^'^ '^^^-^^ "^"^^'"a ^^'^^^ t^'e last pack in the ILVU to which 

itJ, ir - f ^" I addresses are expressed as the number of sectors from the navigation pack NV"contain- 
55 ?a 0 ff?;S^°p"^i°"- "° *"*cating thafthere^s no ang^^t^ 

Si « . S,2Si. tJ^J!,"^ 'T'^T^ P^** ^'''"■^^ ^"'^ "^-'L^U ««« addr^ for each angle dSa S 

fidS u:ne^™ti™r^ "''^ ^^'^^^ 

For interleaving data in the multi-angle scene period, all angles are interleaved to the same time reference (inter- 
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leave boundary) using the angle interleave unit A-ILVU for the shortest read time. This Is to enable the angle to be 
i^rS^ Thllf^rH^ '""^ performance limits of the DVD player. Interleave unit data is temporarily 

stored to the frack buffer, and the data for the angle selected next is then input to the track buffer. However the nejrt 

^hfl!,!^r"°lK ^"9'^ (^l^^ ^"9'« b«'"9 reproduced when the angle was 

^ A^tfl^'? ! consumed. It is therefore necessary to minimize the size of the angle interleave 

unit A-!LVU m order to maximize the speed at which the next angle scene can be selected and presented. A common 
interleave unrt size and boundary position must therefore be used between the VOB constituting each angle 
s,r.J^^r^^T ^^V^-e '■eP'oduction time of the encoded video stream forming the VOB must be the same for each 
VOB. andihetime at which each interleave unit can be reproduced must be the same, i.e.. the interleave unit bounda- 
ries must be common, for each interleave unit at the same reproduction time in each angle. More specifically, the VOBs 
^II^T'^ ^ch angle must be divided into the same number of interleave units, and the reproduction time of said 
nT.^TMor'S 7 ^'^^Z^l^u constituting each angle must be divided into the same 

tioJItime interleave unit (where 1 s k ^ N) in each angle must have the same reproduc- 

Moreover, to seamlessly reproduce the interleave units between each angle, the encoded stream must be com- 

Sn^i'lT/r* ■^'='"^"=*'^=*""de^*^eMPEGstandaid. aclosedGOPstructureusinga compres- 

sion method that does not reference any frames outside the interleave unit must be used. If this method is not used it 
IS not possible to seamless connect and reproduce interleave units from different angles. By using this VOB structure 
and irrterleave unit alignment, however, contiguous reproduction is possible time-wise even if the angle is changed 
th. ^® of interleave units in the multi-angle scene period is determined by the number of interleave unite in 

the other angl^ that can be arrayed within the jumpable distance after an interleave unit Is read. Regarding the 
arrangement of the interleaved unite in each angle, the interleave unite reproduced first in each angle are arrayed i>i the 
Snnf'"^"''®' T subsequently followed by the interleave unite reproduced next in each angle being arrayed in 
!lf £ ™^be^ of angles is M (where M is a natural number, and 1 ^ M s 9), the m-th angle is 

^M^. (where m is a natural number, and 1 ^ m ^ M). the number of interleave unite is N (where N is a natural 

^^TJ^^,l ^"^ ^""^ ^ '"*«^'«a^e unit #n (Where n is a natural 

number and 1 ^ nj N), the interleave unit sequence Is angle #1 interleave unit #1, angle #2 interleave unit #1 . angle 
#3 irterleave unit #1 . . . . angle #M interleave unit #1 . angle #1 interleave unit #2. angle #2 interleave unit #2 

If the interleave unit length of each angle is the shortest read time for seamlessly selected angles where 'the angle 
change is seamless, the maximum distance that must be jumped when moving between angles is the distance from frie 
first angleinterleave unrt in the sequence to the last interleave unit in the interleave unit sequence of the next angle 
reproduced w*iin the sequence of angle interleave units reproduced at the same time. Thus, if the number of angles is 
An. the jump distance must satisfy the following equation 7. 



max. angle ILV U length x (An - 1) x 2 s jumpable distance 



[7] 



• V multhangle switching, each angle must be seamlessly reproduced, but seamless reproduction 

IS not required when moving between angles. Therefore, if the interleave unit length of each angle is the shortest read 
time, the maximum distance that must be jumped when moving between angles is the distance between the interleave 
units of each angle. Thus, if the number of angles is An. the jump distance must satisfy the following equation 8 



max. angle ILVU length x (An - 1) ^ jumpable distance 



[8] 



The method of managing addresses on the switching unit level between multiple angle data VOB in multi-anale 
scene periods is described below with reference to Figs. 49 and 50. In Fig. 49 the angle interleave unit A-ILVU is frie 
data switching unit, and the address of another angle interleave unit A-ILVU is written to the navigation pack NV of each 
angle interleave unit A-ILVU. Fig. 49 shows the address description achieving seamless reproduction. i.e uninter 
t'h?f *T*S r ^"^ '^'^^ "^^^ ™^ addressing method specifically providerfor control whereby only 

the data for the interleave unite of the angle to be reproduced is read into the track buffer when the angle is changed 

Fig. 50 shows an example in which the video object unit VOBU is the data switching unit, and the address of 
another video object unit VOBU is written to the navigation pack NV of each video ot^ect unit VOBU. This addressing 
tn l^^h^'™' f ^ non-seamless reproduction control whereby reproduction can be changed as quickly as possible 
to another angle near the tme when the angle is changed. y •»» Hoswme 

In Fig. 49. each angle interleave unit A-lLvu In the three multi-angle data VOB-B. VOB-C. and VOB-D records as 
M /I f^o o T^. '"terleave unit A-ILVU to be reproduced the address of a chronologically later A-ILVU 
Note that VOB-B is designated angle #1 . VOB-C is angle #2. and VOB-D is angle #3. The murti-angle date VOB B con: 

^til^"^ .f • ^"^ ^W-ans'e data VOB-C similarly consiste of angte 

interleave units A-ILVUcI . A-ILVUc2. and A-ILVUcS. and multi-angle data VOB-D of angle interleave unite A-ILVUdI A 



36 

BNSDOCID: <EP 0847200A1J > 



EP0 847 200 A1 



ILVUd2. and A-ILVUd3. 

The navigation pack NV of angle interleave unit A-ILVUbl contains SML_AGL_C#1_DSTA pointing to the relative 
address of the next angle Interleave unit A-ILVUb2 in VOB-B. as shown by line Pb1b; SML_AGL_C#2_DSTA pointing 
*f ^!lf ^'"'^ ^"^"^'^^ °^ ^^^"^ interleave unit A.|LVUc2 synchronized to the same (next) angle interleave unit 
5 A-ILVUb2 as shown by line Pbl c; and SML_AGL_C#3_DSTA pointing to the relative address of the VOB-D angle inter- 
leave unit A-lLVUd2 as shown by line Pbld. 

As shown by lines Pb2b. Pb2c. and Pb2d. the navigation pack NV of the next angle interleave unit A-ILVUb2 in the 
same video object VOB-B likewise contains SML_AGL_C#1_DSTA, SML_AGL_C#2_DSTA, and 
SML_AGL_C#3_DSTA pointing to the relative address of the next angle interieave units A-ILVUb3 A-ILVUc3 and A- 
: io ILVUdS.in VOB-B, VOB-C, and VOB-D..respectively. ' ' 

Note that the relative addresses are all expressed as the number of sectors from the navigation pack NV of the 
VOBU contained in each interleave unit. 

Addresses are similarly written to the navigation pack NV of the first angle Interieave unit A-ILVUc1 in VOB-C i e 
SML_AGL_C#2_DSTA pointing to the relative address of the next angle interleave unit A-ILVUc2 in VOB-C as showri 
by line Pcic; SML_AGL_C#1_DSTA pointing to the relative address of the same (next) angle interleave unit A-ILVUb2 
in VOB-B. as shown by line Pel b; and SML_AGL_C#3_DSTA pointing to the relative address of the VOB-D angle inter- 
leave unit A-ILVUd2 as showvn by line Pcld. 

As shown by lines Pc2c. Pc2b. and Pc2d, the navigation pack NV of the next angle interleave unit A-ILVUc2 in VOB- 
C likewise contains the relative addresses SML„AGL_G#2_DSTA. SML_AGL_G#1_DSTA, and SML_AGL„G#3 DSTA 
pointing to the next angle interleave units A-ILVUcS, A-ILVUb3. and A-ILVUd3 in the respective video objects VOB 

Again note that the relative addresses are all expressed as the number of sectors from the navigation pack NV of 
the VOBU contained in each interleave unit. 

Addresses are similarly written to the navigation pack NV of the first angle interleave unit A-ILVUd1 in VOB-D, i.e.. 
SML_AGL_C#3_DSTA pointing to the relative address of the next angle interleave unit A-ILVUd2 in VOB-D as shewn 
by line Pdid; SML_AGL_C#1_DSTA pointing to the relative address of the same (next) angle interleave unit A-ILVUb2 
m VOB-B. as shown by line Pdl b; and SML_AGL_C#2_DSTA pointing to the relative address of VOB-C angle interleave 
unit A-ILVUC2 as shown by line Pdl c. 

As shown by lines Pd2d. Pd2b, and Pd2c. the navigation pack NV of the next angle Interleave unit A-lLVUd2 in 
VOB-D likewise contains the relative addresses SML_AQL_C#3_DSTA, SML_AGL_C#1_DSTA, and 
SML_AQL_C#2_DSTA pointing to the next angle interleave units A-ILVUd3. A-ILVUb3. and A-ILVUc3 in the resoective 
video objects VOB. ^ 

Again note that the relative addresses are all expressed as the number of sectors from the navigation pack NV of 
the VOBU contained in each interleave unit. 

In addition to the addresses SML_AGL_C#1_DSTA - SML_AGL_C#9_DSTA. each navigation pack NV also con- 
tains vanous parameter data as previously described with respect to Fig. 20. and further description thereof is thus 
omitted for simplicity. 

V. This address information more specifically includes in the navigation pack NV of angle interleave unit A-ILVUbl for 
exannple. the end address ILVU.EA of the angle interleave unit A-ILVUb1 to which the navigation pack NV belongs and 
the addresses SML_AGL_C#1_DSTA. SML_AGL_C#2_DSTA. and SML_AGL_C#3.DSTA of the navigation packs NV 
of the next angle interleave units A-ILVUb2. A-ILVUc2. A-ILVUd2 that can be r^roduced. The navigation pack NV of A- 
ILVUb2 contains the end address ILVU.EA of A-ILVUb2. and the addresses SML_AGL_C#1 DSTA 
SML_AGL_C#2.DSTA. and SML_AGL_C#3_DSTA of the navigation packs NV of the next angle interleave units A- 
ILVUbS. A-ILVUC3. A-ILVUd3 reproduced. The navigation pack NV of A-ILVUb3. the last interleave unit in the sequence 
in this example, contains the end address ILVU_EA of A-ILVUb3. and termination information as the address of the nav- 
45 igation pack NV of the next A-ILVU r^roduced. e.g.. a NULL value or string of alM s as the 1LVU_EA. 

The specifics of the address information written to the other video objects VOB-C and VOB-D in this example are 
the same. 

By writing this address information to the navigation packs NV of each angle interleave unit A-ILVU. it is possible to 
read ahead the address of the next A-ILVU to be reproduced in chronological sequence, and is therefore suited to 
seamless r^roduction. Furthermore, because the address of the next A-ILVU in each of the other available angles is 
also recorded to each navigation pack NV. the next address of the selected angle can be easily obtained without giving 
special consideration to whether the angle is changed or not. and junrping to the next interleave unit can be controlled 
by the same control sequence. 

By thus recording the relative addresses of each A-ILVU that can be selected from each angle, and constructing 
the encoded video stream contained in each A-ILVU from closed GOP. seamless reproduction without video disruption 
can be achieved when the viewing angle is changed. 

The audio data can also be seamlessly reproduced if the same audio is recorded for each angle, if the audio is 
complete within each ILVU. or if discrete audio data ss recorded. Moreover, if identical audio data is recorded to each 
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^' "^T^r " to discern that the audio tmck has changed if the audio is seam- 

lessiy reproduced across angle changes. 

n^rr-llST f "^1'^ ^^^""^ non-seamless reproduction of angle changes, i.e.. seamless data reproduction permitting 
perceptible breaks in the content of the reproduced information, is described below with reference to Fig 50 
vom iK^^T '? ?.f?,^f '^^ comprises three video object units VOBUbl , VOBUb2. and 

v/So VT' similarly comprises three video object units VOBUcl. VOBUo2. and VOBUcS and 

^^tn^Ti^r* ^^i^"* """" and VOBUd3. As in the case shown in Rg. 49. the nav- 

gation pack NV of each video object unit VOBU contains the end pack address VOBU EA of each VOBU Note that 

^d onl r ''^Sl-f M,' "^""'^ °' ^ ^ - « VOBU coi^prising a navigation pS< NV 

~1 nS S^rh x/orT.^ .T^ NSML_AGL_C#_DSTA address wrWen to the na^gation 

^ck NV of each VOBU does not descnbe a chronologically later VOBU address, but the address of a VOBU in a differ- 
ent angle with a reproduction time preceding the time the angle is changed 

ni, JT^fUfi '"""^^l.tS^LM^^^ NSML_AGL_G#1_DSTA to NSML_AGL_C#9_DSTA to VOBU in other angles synchro- 
S 2 1^^ ZTJ^^ ■ *^ '^^'^'^ fields in JSan 

?^fi 1 n= 1^ JIl^KuTT^!.''*'^ ^ ^ °- '"^''^ "^'^^ does not exist is recoiled. 

L shc^^?ni?Sf SJpWcJ °* synchronized VOBUcl and VOBUdI in V^B-Q-and ^B-D 

,jr^H"*'^^^Mof« *.IiY ^^^'^ ^^^^''^ similarly contains as shown by lines Pb2c' and Pb2d' the rel- 

ative addresses NSML_AGL_C#2_DSTA and NSML_AGL_C#3_DSTA of the synchronized VOBUc2 and VOBUdT ^e 
navigaton pad< NV of video object unit VOBUbS similarly contains as sho«m by lines PbSC and PbSd' the rLtive 
addr^ses NSML_AGL_C#2_DSTA and NSML_AGL_C#3_DSTA of the synchronized VOBUc3 and VOBUdT 

The navigation packs NV of video object units VOBUcl , V0BUc2. and VOBUcS of VOB-C similarly contain the rel- 

shown by lines Pdlb'. Pdic. Pd2b', Pd2c', Pd3b', and PdSC. 

«n„iirL^"2f ^'^'^ information NSML_AGL_C#4_DSTA to NSML_AGL_C#9_DSTA for non-existent 

angles #4 - #9 inthe example record a value indicating that corresponding angles do not exist, e.g., a 0 value 

VOBuTta '^r^^^- ^"^i.'^^.S ^^^""^ '"^'"^ reproduction of the angle 

fo?ttlie s^a^Tie^'^ reproduced when the angle is changed, then reads and begins reproducing the VOBU data 

voR^f ®n^^* ^ ^ irrterleaved units of VOB-C relative to VOB-B and 

^vfoSinn ™;^M^^'^ ^^^^ understanding of the address descriptions written to the respective 

navigation pa^ NV of each VOB using the line arrows as shown. There is. in fact, no time shifting between the respec- 
tive interieaved video objects VOB, which are aligned as shown in Fig. 49. ^ 

r'®™ structure shown in Fig. SO thus contains as pointers to the next VOBU to be reproduced addresses to 
t^ntrtH?«J^ ^ "1°"" T"^' Simultaneously with or chronotogically beforelnfoB,!^^^ 

Sfr, ^m!^"^ ^^TI"- ^9'^ reproduction is continued from a scene at a past 

Sr^Te L nrlfmSr^'"' ^'^^ ^^^'^^ switching not 

required, i.e.. for non-seamless information reproduction in which contiguity is not required in the reproduced informe- 
rs Flow chart: encoder 

thP ^^^"^ ""^^I'er 200 from information extracted from 

the scenario data St7 is descnbed below refening to Fig .27. w ■ i 

JSTk®""^-"^ iriformation table contains VOB set data streams containing plural VOB corresponding to the scene 
i?^'"^ ^^nT*?^ ^* '"^"^ '"■^'=^'"9 ^"'^ P""*- ^ VOB data streams corr^^nc^nTto 

^Rn^i h 2 ^ ""'^ 2^ information tables generated^ep X 

rarterrt ^" ^^^^"^ ^^"^ multimedia stream based on the user-defined title 

.« rJU'J ^''^''^^^ branching points from common scenes to plural scenes, or connection points 

S,i^" a >rB°sTa:^^^^^^^ corresponding to the scene period delimited by these bmnching and conneS^ 
voR ?f T: il ^1 generated to encode a VOB set is the VOB set data stream. The title number specified 
by the VOB set data stream is the title number TITLE_NO of the VOB set data stream speoiiea 
The VOB Set data structure in Fig. 27 shows the data content for encoding one VOB set in the VOB set data 
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stream, and comprises: the VOB set number VOBS.NO. the VOB numt)er VOB_NO in the VOB set. the precedinp VOB 
sexless connection flag VOB_Fsb. the following VOB seamless connection flag VOB Fsf. t^rmuW-Srne fteo 
^eLLu: Kr^""/;^" • "^^-^^^^^^^ ^OB.Fm. the multi-angle sLmle^ switTh^g f^^ VOB FsV 

the m^nmm brt rate of the .nterleaved VOB ILV^BR. the numberKif interleaved VOB divisions ILV DIV and *e"rS 
mum interleaved unit presentation time ILVU_MT. ii-v.uiv. ana me mini- 

^errpro^<^rsC:LT*'e2£ 

duc.^n^Z;ceTt;r««^^^^^ 
ingVOBS:Sri.rs:r:^^^^^^ 

follo^gVoTZr^^c^^^^ 

S ® flag VOB_Fp identifies whether the VOB set comprises plural video objects VOB 

75 The interleaveflagVOB^R identifies whetherthe VOB in the VOB set areinterleaved 
The multi-angle flag VOB_Fm identifies whether the VOB set is a multi-angle set 

peri^^re sSirnrt"" «^««^- an^le changes wfthin the multi-angle scene 

The rmximum bit rate of the interleaved VOB ILV.BR defines the maximum bit rate of the interleaved VOBs 

^^^^^^::rn1=^^ 

nario^t^"IS^rdi2SS'K",'^!j°^ ^^"^"^'^ ''^ *^ ^J^^'" 200 based on the sce- 

dKcnbed below refemng to Fig. 28. The VOB encoding parameters described below and supplied to 

Tn^c^lng .rSioTta^r ""^^ ^^"^ ^""^^^ - ^"'^ ^^^^^ 

iho ZUllf?^ »" ^3 28 are the encoding information tables generated at step #1 00 in Fia 51 bv 

H«t»^ ' ^''^ ^"^ generated to encode each video object VOB is *e VOB 

tt^l^Z^- ^'^'f • I ""^^ ""^"^"S video obS VOB -Se ^te 

^ »?^^ ^® *e content of the data for encoding one VOB in the VOB data stream 

The VOB data structure contains the video material start time VOB.VST. the video material end time VOB VEND 
*.e vdeo s-grial^e VOB_V_KIND. the video encoding bit rate V_BR. the audio material start time JoB AST le 
aud.o material end time VOB_AEND. the audio coding method VOB_A_K.ND. and the audio encoding ti rS; A b? 
The video matenalstarttimeVOB.VSTisthe video encoding start time corresponding to the time^^^^^ 

The video material endtimeVOB.VENDisthe Video encoding end time corresponding to the time of the vW^^ 
...^11^^ "H^"^' ^ VOB_V_KIND identifies whether the encoded material is In the NTSC or PAL format for 

The video encoding bit rate V_BR is the bit rate at which the video signal is encoded 
4s nal. '^OB_AST is the audio encoding start time corresponding to the time of the audio sig- 

The audb material end time VOB_AEND is the audio encoding end time corresponding to the time of the audio sig- 
exanjr"'*'" "^'"^ '"^^ VOB_A_KIND identifies the audio encoding method as AC-3. MPEG, or linear PCM. for 
The audio encoding bit rate A_BR is the bit rate at which the audro signal is encoded 

The enradtng parameters used by the video encoder 300, sub-picture encoder 500. and audio encoder 700 and 
VOr'T.o"'?'' VOB encoding are shown in Fig. 29. The encoding parameters indSe mT??B SuirS'r 

VOB NO. ^"deo encode start time V_STTM, video encode end time V.ENDTM the video encode mcJe V ENcSS 

^v lND^ f^M rl?^'^ "^"^'^ "^"^ VJINrrex. the last Video enccSe 

i^^P * ' ? ^ """^ ^« ^ ^'"e AJEmiM. the audio encode bit^e 

1? f,^« ^0°"*" A.ENCMD. the audfo start gap A.STGAP. the audio end gap A ENdSp the 

ceding VOB number B_VOB_NO. and the following VOB number F VOB NO _«=iNuuMr. me pre 
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The video encode bit rate V_RATE is the average bit rate of video encoding. 
tT. ^T"^ . '""if" ''-'^''''■^ "^^"^ bit rate of video encoding 
struJure?n°hetSro 7el^^^^^^^^^ ^'''T ^"^'"^ accomplished v^out changing the GOP 

The video encode GOP structure GOPST is the GOP structure data from encoding 

The audio encode start time A.STTM is the start time of audio material encoding 
The aud.o encode end time A_ENDTIV1 is the end time of audfo material encSirJ' 
The audio encode brt rate A.RATE is the bit rate used for audio encoding 
^ The audio encode method A.ENCMD Kientif ies the audio encoding method as AC-3. MPEG, or linear PCM for 

n^f-sr^^^^^^^ 

necKd precMIng VOR B_VOB_NO e the VOB_NO 01 me preceding VOB »hen Ihere Is a seamlessly 

opemHon deecLd b^\^^^l^l^V"l"' " »»< while «e 

a.on described also applie^tS^SS^^IT ° ^° ^° " "'"^ 

co,ZT«ri»*:r^rdr^rrsr2re:;?i?'"«»*^-^^^^^ 

Obtained from Sons 3 i^d 4^s^^ Z enrLTfrSnnV'" °* s^'ortest interleaved unit is 
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scene e a multi-scene period, a seamless connection still refers to seamlessly connecting the target scene with any 

one of the scenes from the same multi-scene period. 

If step #300 returns NO. i.e.. a non-seamless connection is valid, the procedure moves to step #400 
. At step #400, the encoding system controller 200 resets the preceding VOB seamless connection flag VOB Fsb 

5 indicating whether there is a seamless connection between the target and preceding scenes. The procedurelhen 

moves to step #800. 

On the other hand, if step #300 returns YES." i.e., there is a seamless connection to the preceding scene the pro- 
cedure moves to step #500. =. "i«SH'u 

At step #500 the encoding system controller 200 sets the preceding VOB seamless connection flag VOB Fsb The 
10 procedure then moves to step #600. w _rt«. me 

At stqj #600 the encoding system controller 200 determines whether there is a seamless connection between the 
target and following scenes based on scenario data St7. H step #600 returns NO. i.e.. a non-seamless connection is 
valid, the procedure moves to step #700. 

At step #700. the encoding system controller 200 resets the following VOB seamless connection flag VOB Fsf indi- 
cattng whether there is a seamless connection wrth the following scene. The procedure then moves to step #900 

.r,rJ^f' '^"^ ^^'^ ^ seamless connection to the following scene, the procedure 

moves to st^ #800. 

At step #800 the encoding system controller 200 sets the foilowring VOB seamless connection flag VOB Fsf The 
procedure then moves to step #900. ""-rai .me 

At st^ #900 me encoding system controller 200 determines whether there is more than connection target scene 
i.e.. wrfiether a mult-scene period is selected, based on the scenario data St7. As previously described, there aretwci 
^sable control methods in multi-scene periods: parentel lock control whereby only one of plural possible reproduction 
^ that can be constructed from the scenes in the multi-scene period is reproduced, and multi-angle control whereby 
the reproduction path can be switched wnthin the muHi-scene period to present different viewing angles 
If step #900 returns NO, i.a. there are not multiple scenes, the procedure moves to step #1000 
At step #1 000 the multi-scene flag VOB.Fp identifying whether the VOB set comprises plural video objects VOB (a 
multi^ene period is selected) is reset, and the procedure moves to step #1800 for encode parameter production Th s 
encode parameter production subroutine is described below. 

However, if step #900 returns YES. there is a multi^cene connection, the procedure moves to step #l lOO 
At step #1 100. the multi-scene flag VOB_Fp is set and the procedure moves to step #1200 whereat it is judged 
whether a multi-angle connection is selected, or not. 

At step #1200 it is detennined whether a change is made between plural scenes in the multi-scene period i e 
whether a mult-angle scene period is selected. K step #1200 returns NO, i.e., no scene change is allowed in the riiulti- 
3B to sti #1300°^ ^'^^ reproduction path has been selected, the procedure moves 

ic «f the multi-angle flag VOB_Fm identifying whether the target connection scene is a multi-angle scene 

IS reset, and the procedure moves to step #1 302. 

v,^r>'^* " determined virhether either the preceding VOB seamless connection flag VOB Fsb orfbllowina 

^l^^ """"^f^"" "1' ''2^-'' " ^^"^ ^^S- ■ "^^^ connection scene seamless' 

connects to the preceding, the following, or both the preceding and following scenes, the procedure moves to step 

At step #1304 the interleave flag VOB.Fi identifying whether the VOB. the encoded data of the target scene is 
interleaved is set. The procedure then moves to step #1 800. « aci ««ne, is 

Ji!^^^"' returns NO. i.e., the target connection scene does not seamlessly connect to the preceding 

45 or following scene, the procedure moves to Step #1306. cMi««.wjiiig 
At st^ #1 306 the interleave flag VOB_R is reset and the procedure moves to step #1 800 

1^^- *ere is a multi-angle connection, the procedure moves to step #1400 

#1500 "uilti-angle flag VOB.Fm and interleave flag VOB.Fi are set. and the procedure moves to step 

At^ep #1500 the encoding system controller 200 determines whether the audio and video can be seamlessly 
f ^ ^ reproduction unit smaller than the VOB. based on the scenario data 

St7. If step #1500 returns NO. i.e.. non-seamless switching occurs, the procedure moves to step #1600 

#1600 the multi-angle seamless switchingf lag VOB.FsV indicating whether angl^ changes within the multi- 
angle scene penod are seamless or not is reset, and the procedure moves to step #l 800 

However, if step #1500 returns YES. i.e.. seamless swvitehing occurs, the procedure moves to step #1 700 
At stqp #1700 toe mult-angle seamless switohing flag VOB.FsV is set and the procedure moves to step #1800 
If ^ ^ ""^ ''^^ in Rg. 51 , encode parameter production (step #1 800) is only begun after the 
editing informaton is detected from the above flag settings in the scenario data St7 reflecting the user-defined editing 
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n^t^TJn^, Z <nstructions detected from the aboveflag settings in the scenario data St7, infor- 

^^.Thf . .nformation tables for the VOB Set units and VOB units as shown in Figs. 27 and 23!, 

5 « fiS source streams, and the encoding parameters of the VOB data units shown in Rg. 29 are p^uced in s^ 
5 *1800. The procedure then moves to step #1900 for audio and video encoding e proaucea. in step 

54. ^S°°^^ Pa-anieter production steps (step #1800) are described in greater detail below referring to Figs. 52, 53. 

*ion^*i?r parameters produced in step #1800. the video data and audio data are encoded in steo 

#1900. and the procedure moves to step #2000. »e encoaea in step 

with i,™?-?-^ " """""^"^ '"^^""^ ^"""9 '■eP'oduction on an as-needed basis, and contiguity 

SI ^^^'"^/"^ is therefore not usually necessary. Moreover, the sul>picture data is^orS 

.nformation for one frame, and unlike audio and video data having an extended time*ie. suSre date fe 
.^aHy static, and is not normally presented continuously. Because the present invention relates specifically to s^m 

Step #2000 is the last step in a loop comprising steps #300 to step #2000. and causes this loop to be reoeated as 
many tmes as there are VOB Sets. This loop formats the program chain VTS PGC#i to me rSSuflion 

mterieaves the VOB m the multi-scene periods, and completes the VOB Set data stream and VOB data stream needed 
for system stream encoding. The procedure then moves to step #2100 

Of v5L?ete'^OBS*^Nn2^^ 'S' ^""^"^ ? co^i^^ as the encoding information table by adding the total number 
Of VOB Sets yOBS.NUM obtained as a result of the loop through step #2000 to the VOB Set data stream and settino 

System stream encoding producing the VOB (VOB#i) data in the VTS title VOBS (VTSTT VOBS) fFic 16^ i<; 

^ST""'!?.'" ^'"^ "^"^ °" ^"^^ ^^^^-^ ^ ^<^^ a"dio sfrim outs S # 900 
and the encode parameters in Fig. 29. The procedure then moves to step #2300 

\rrs'%Sc?rTnH^r^ I?™!!?" "^"^S^ment table VTSLMAT. VTSPQG information teble 

VTS.PGCIT. and the program chain information VTS_PGCI#i controlling the VOB data reproduction sequence sh^m 
LJ^ ''^'"^■f'^ *^'"=«"9 to. for example, interleave the VOB contained in tSe S.W-i7ne pe'^ 

«a 1!!^^°°^^ parameter production subroutine shown as step #1800 in Fig. 51B is described next using Figs 52 

Srt^aTmlT. «r "^'^ *t°P«^««°" S-^-^^^S encode parameters for multi-angle control ' 
muHi^ 0 ^ ^ ' *f P""'^ generating the encode parameters of a non-seamless switching stream with 
rnuHi-angle control is descnbed first. This stream is generated when step #1500 in Fig. 51 retums NO and the SfoTna 
«ags are set as shown: VOB.Fsb = 1 or VOB.Fsf . 1 . VOB_Fp = 1 . Voi_Fi = 1 , vol Fm ! 1 .^^ V^^^FsV - oTe 

Slip's fK°" ^ ^""^'"^ "^^^ ^"^ '^'s- ^'^ 

^^le scenarfo reproduction sequence (path) contained in the scenario date St7 is extracted the VOB 

At Step #1 814 the maximum bit rate ILV_BR of the interleaved VOB is extracted from the scenario date St7 and the 
m^mum video encode bit rate V.MRATE from the encode parameters is set based on the im?r3«ag S^fset 

M 1] r!r Ih! presentation time \LVU_MT is extracted from the scenario date St7 

At step #1818. the video encode GOP structure GOPST values N = 15 and M = 3 are set and the GOP^.h..™ 
foang flag GOP_Fxflag is set (= 1). based on the multi-scene flag VOB.Fp setting (= 1) 

This^of S(?B*^daS'Tr^^^^^^^ T"^- "^^"^ '^"^"^ to '""^ chart in Fig. 53. 

ea J^Sr^/hhT ^'■h ^'^^^ "If t''"^ VOB.VST and video material end time VOB.VEND are extracted for 

At Step #1 824 the audio material stert time VOB_AST of each VOB is extracted from the scenario data St7 a„ri 
audio encode stert time A_STTM is set as an audio encoding parameter ' ^""^ 

At step #1 826 the audio material end time VOB_AEND is extracted for each VOB from the scenario data St7 and 
at a tome not exceeding the VOB.AEND time. This time extracted at an audio access unit (AAljrsrt as the au^o 
encode end tme A.ENDTM which is an audio encoding parameter. Note that the audfo accessTtt L?is d JteZ Jd 
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by the audio encoding method. 

At step #1828 the audio start gap A_STGAP obtained from the difference between the video encode start time 
V_STTM and the audio encode start time A_STTM is defined as a system encode parameter. 

At step #1830 the ai^io end gap A_ENDQAP obtained from the difference between the video encode end time 
V_ENDTM and the audio encode end time A_ENDTM is defined as a system encode parameter. 

At step #1832 the video encoding bit rate V_BR is extracted from the scenario data St7, and the video encode bit 
rate V_RATE, which is the average bit rate of video encoding, is set as a video encoding parameter. 

At step #1834 the audio encoding bit rate A_BR is extracted from the scenario data St7, and the audio encode bit 
rate A_RATE is set as an audio encoding parameter. ; 

At step #1 836 the video material type VOB_V_KI ND is extracted from the scenario data St7. If the material is a film 
type, i.e., a movie converted to television broadcast format (so-cali«J telecine conversion), reverse telecine conversion 
is set for the video encode mode V_ENCMD. and defined as a video encoding parameter. 

At step #1838 the audio coding method VOB_A_KIND is extracted from the scenario data St7. and the encoding 
method is set as the audio encode method A_ENCMD and set as an audio encoding parameter. 

At step #1840 the initial video encode data VJNTST sets the initial value of the VBV buffer to a value less than the 
VBV buffer end value set by the last video encode data V_ENDST, and defined as a video encoding parameter. 

At step #1842 the VOB number VOB_NO of the preceding connection is set to the preceding VOB number 
B_VOB_NO based on the setting (= 1) of the preceding VOB seamless connection flag VOB_Fsb. and set as a system 
encode parameter. 

At step #1844 the VOB number VOB_NO of the following connection is set to the following VOB number 
F_VOB_NO based on the setting (= 1) of the following VOB seamless connection flag VOB__Fsf. and set as a system 
encode parameter. 

The encoding information table and encode parameters are thus generated for a multi-angle VOB Set with non- 
seamless multi-angle switching control enabled. 

The process for generating the encode parameters of a seamless switching stream with multi-angle confrol is 
describe below with reference to Fig. 54. This sti-eam is generated when step #1500 in Fig. 51 returns YES and the 
following flags are set as showvn: VOB_Fsb = 1 or VOB_Fsf = 1 , VOB_Fp = 1 , VOB_Fi = 1 , VOB_Fm := 1 . and VOB_FsV 
= 1 . The following operation produces the encoding information tables shown in Fig. 27 and Fig. 28, and the encode 
parameters shown in Fig. 29. 

The following operation produces the encoding information tables shown in Fig. 27 and Fig. 28, and the encode 
parameters shown in Fig. 29. 

At step #1850, tiie scenario reproduction sequence (patii) contained in the scenario data St7 is extracted, the VOB 
Set number VOBS_NO is set, and the VOB number VOB_NO is set for one or more VOB in the VOB Set 

At step #1 852 the maximum bit rate ILV_BR of the interleaved VOB is exft-acted from the scenario data St7, and the 
-maximum video encode bit rate V_MRATE from the encode parameters is set based on the interleave flag VOB Fi set- 
ting (=1). 

At step #1854, the minimum interleaved unit presentation time ILVU_MT is extracted from the scenario data St7. 

At stqD #1856, tile video encode GOP structure GOPST values N = 15 and M = 3 are set, and the GOP sfructure 
fixing flag GOP_Fxflag is set (= 1), based on the multi-scene flag VOB_Fp setting (= 1). 

At step #1 858, the video encode GOP GOPST is set to "closed GOP" based on tiie multi-angle seamless switching 
flag VOB_FsV setting (= 1), arxj tiie video encoding parameters are thus defined. 

Step #1860 is the common VOB data setting routine, which is as described refemng to the flow chart in Fig. 52. 
Furtiier description thereof is thus omitted here. 

The encode parameters of a seamless switching stream wrtii multi-angle control are thus defined for a VOB Set 
with mufti-angle control as described above. 

The process for generating the encode parameters for a system stream in which parental lock control is imple- 
mented is described below witii reference to Fig. 55. This stream is generated when step #1200 in Fig. 51 returns NO 
and step #1304 returns YES. i.e., the following flags are set as shown: VOB_Fsb = 1 or VOB_Fsf = 1, VOB_Fp = 1, 
VOB_Fi = 1 . VOB_Fm = 0. The following operation produces the encoding information tables shown in Fig. 27 and Fig! 
28, and the encode parameters shown in Fig. 29. 

At step #1870, the scenario r^roduction sequence (patfi) contained in the scenario data St7 is extracted, the VOB 
Set number VOBS_NO is set. and tiie VOB number VOB_NO is set for one or more VOB in the VOB Set. 

At step #1872 the maximum bit rate ILV_BR of tiie interleaved VOB is extracted from the scenario data St7, and tfie 
maximum video encode bit rate V_MRATE from the encode parameters is set based on the interleave flag VOB Fi set- 
ting (=1). 

At step #1872 the number of interleaved VOB divisions ILV_DIV is extracted from the scenario data St7. 
Step #1876 is the common VOB data setting routine, which is as described refen^ing to the flow chart In Fig. 52. 
Further description thereof is thus omitted here. 
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beloI'^rSnS to ngll'^s ^^^^^TeneSr^ \ ' T a single scene is described 
The following operation prSdLst^nccSinaSrml^^^^ '"Z'^" '^"'"^ VOB_Fp=0. 

eters shown in Fig. 29. ^'"^ 'nformabon tables shown m F.g. 27 and Fig. 28, and the encode param- 

Set n'rirvoTsToTsTraTr^^^^^ 

At sten iiiftftoih^ • numoer VOB_N0 is set for one or more VOB in the VOB Set 

ttig (. 1). V.MRATE Imm ih. encod. pasMere Is set bassd on ft, int9rlea«e(laB VOB_R M- 

Formatter f Inwg 

procedure moves to step «3?rif^S^3i6 reSrYS"'"^ T information is not to be interleaved, the 

moves to step #2318. ^ "° "*"-"««°" to be interleaved, the procedure 

cuted. If step #2318 returns YES. the procSure moJes to^^p ^^^^^^^ '""""^ *2320 is exe- 

shoj:; '^^^^ -cuted. ^3 subroutine is 

.ess^chin?anLep-#2r22"r;sTtr^^^^^ 

Tne multi-angle non-seamless switching control routine executed in ctoni»QoeKw4u ^ 
mg encoder EC in Fig. 25 is described later with reference t^ R?^ ^ ^''^ ' °* 

dure^o:;^ to stW^32? ' ^"^"^^'^ '^""'^ ^^'^ ' step #2322 returns YES. the proce- 

The multi-angle seamless swwitching control routine execijt«>ri in c»or. nonoj, »u x_ 
encoder EC in Fig. 25 is described Iate7with rieTe^Jto ^ S °' ^"^^^'^^ 

descSi'edttSen^S^'S^"^'"" ^'"^ ^^'^ ^-^^'^ °' information VTSI set as previously 

^oc^X^^^^^^^ l^^^OB set number VOBS.NUM t«ve been 

bteen formatted, the procedure terminal^ ^ ' ^ '""^ ^9*"- ^^S. all sets have 

*.322^Srr2ns"NO : rr^^C^Z^efrS^^^^^ -^^^^ «*ep 

MBS. the content of the cell playback informatir?rp£ffi^^t!^!n7f i ^ anangement of the multimedia bitstream 
«onpaJNV Shown in Fig. 2^0. J^thegenSrolV^^^^^^ 

At step #2340 based on the mul«-anglef^gVOB_Fmset.ing(=i,dec.aringwhethermulti-a^^^^ 
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in the mutti-scene period, the cell block mode CBM (Fig. 16) of the cell playback information blocks C_PBI #i containing 
the VOB control information for each scene is declared according to the position of the angle data. For example the cell 
block mode CBM of the MA1 cell (Fig. 23) is declared as 01 b to indicate the beginning of the cell block the CBM of MA2 
IS declared as 10b to indicate a cell between the first and last cells in the block, and the CBM of MA3 is declared as 1 1b 
5 to indicate the end of the cell block. 

At step #2342 based on the multi-angle flag VOB_Fm setting (= 1) declaring whether multi-angle control is applied 
in the multi-scene period, the cell block type CBT (Fig. 16) of the cell playback information blocks C_PBI #i containing 
the VOB control information for each scene is declared as 01b to indicate an "angle." 

Atstep #2344theseamlessplaybackflagSPF(Flg. 16) is set to 1 in the cell playback information blocks C_PBI #i 
— .10. - containing the VOB control information for each scene based on the preceding. VOB seamless connection flag 
VOB_Fsbstate, which is .set.tO;1 to indicate a seamless connection. , , 

At step #2346 the STC resetting flag STCDF is set to 1 in the cell playback information blocks C_PBI #i containing 
the VOB control information for each scene based on the preceding VOB seamless connection flag VOB Fsb state 
which is set to 1 to indicate a seamless connection. 

At step #2348 the interleaved allocation flag lAF (Fig. 16) is set to 1 in the cell playback information blocks C_PBI 
#1 containing the VOB control infomration for each scene based on the multi-angle seamless switching flag VOB FsV 
state, which is set to 1 to indicate interleaving is required. 

At step #2350 the location of the navigation pack NV (relative sector number from the VOB beginning) is detected 
from the title editing unit (VOB below) obtained from the system encoder 900 in Fig. 25, the navigation pack NV is 
detected based on the minimum interleaved unit presentation time ILVU_MT information (a formatter parameter 
obtained in step #1 81 6, Fig. 51 ). the location of the VOBU expressed as the number of sectors from the VOB beginning 
for example, is thus obtained, and the title editing unit VOB is divided into interleave units using VOBU units 

For example, if in this example the minimum interleaved unit presentation time ILVU_MT is 2 sec and the presen- 
tation time of one VOBU is 0.5 sec. then ttie VOB is divided into interleave units of 4 VOBU each. Note that this alloca- 
2S tion operation is applied to the VOB constituting each multi-scene data unit. 

At step «e352 the interleave units of each VOB obtained from step #2350 are arranged in the cell block mode CBM 
sequence (cell block beginning, middle, and end cells) written as the VOB control information for each scene in step 
#2340 to form the interleaved blocks as shown in Rg. 37 or 38. The interleaved blocks are then added to the VTS title 
VOBS (VTSTT_VOBS). Using the cell block mode CBM declarations above, for example, the angle data MAI MA2 
30 and MAS (Fig. 23) are arranged in that sequence. 

At step #2354 the relative sector number from the VOBU start is written to the VOB end pack address VOBU EA 
(Fig. 20) in the navigation pack NV of each VOBU based on the VOBU position information obtained in step #2350~ 

At step #2356 the first cell VOBU start address C_FVOBU_SA and the last cell VOBU start address C_LVOBU_SA 
expressed as the number of sectors from the beginning of the VTS title VOBS (VTSTT_VOBS) are written as the 
addresses of the navigation packs NV of the first and last VOBU in each cell based on the VTS title VOBS 
(VTSTT_VOBS) data obtained in step it2Z52. 

The angle #i VOBU start address NSML_AGL_C1_DSTA - NSML_AGL_C9_DSTA of the non-seamless angle 
information NSML_AGLI (Fig. 20) in the navigation pack NV of each VOBU is written at step #2358 This address is 
expressed as the relative sector number inside the data of the interleaved blocks formed in step #2352 and declares 
the address information (Fig. 50) of the navigation pack NV contained in the VOBU of all angle scenes near the ores- 
entation start time of the VOBU being processed. 

At step #2360 "7FFFFFFFh" is written to the angle #i VOBU start address NSML_AQL_C1_DSTA - 
NSML_AGL_C9_DSTA of the non-seamless angle information NSML_AGLI (Rg. 20) in the navigation pack NV of each 
VOBU if the VOBU being processed is ttie last VOBU of each scene in the multi-scene period. 

This routine thus formats the interleaved blocks for multi-angle non-seamless swrtching control in the multi-scene 
period, and formats the cell control information as the reproduction control information for those multiple scenes 

Referring to Rg. 58, the multi-angle seamless swrtching control routine executed in step #2324 when step «2322 
Fig. 56, retums YES is described. This routine defines the interleaved anrangement of the multimedia bitstream MBs" 
-^?w®"u °^ P'^y^'^'* information (C_PBI#i) shown in Fig. 16, and the Information stored to the navigatiori 

so pack NV shown in Fig. 20. in the generated DVD multimedia bftstream MBS. 

At step #2370 based on the multi-angle flag VOB_Fm setting (= 1 ) declaring whether multi-angle control is applied 
in the multi-scene period, the cell block mode CBM (Rg. 16) of the cell playback information blocks C_PBI #i containing 
the VOB control infomiation for each scene is declared according to the position of the angle data. For example the cell 
block mode CBM of ttie MAl dell (Fig. 23) is declared as 01b to indicate the beginning of the cell block, the CBM of MA2 
IS declared as lOb to indicate a cell between ttie first and last cells in the block, and the CBM of MA3 is declared as l lb 
to indicate the end of the cell block. 

At step #2372 based on ttie multi-angle flag VOB_Fm setting (= 1) declaring whettier multi-angle control is applied 
in the multi-scene period, the cell block type CBT (Rg. 16) of the cell playback information blocks C_PBI #i containing 
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the VOB control information for each scene is declared as 01b to indicate an "angle." 

^nfS n^^r ^y^*!"^ °®^"'!^ ^^""^"^ ■'^^ to 1 cell playback information blocks C PBI #1 

VOB_Fsb state, which is set to 1 to indicate a seamless connection 

the viB^oSnnfofil^ resetting flag STCDF is set to 1in the cell playback information blocks C PBI #i containing 

^i^^^^T I TT ^^'^^ ^^^^ °" P'^^"^ s^-^'^ss connection flai VOB Fsb state 

which IS set to 1 to indicate a seamless connection. "o_>-!.o swie, 

#i conteiSn*fhJt?o ®^ *° ' P'^Vba* information blocks C PBI 

* containing the VOB control information for each scene based on the multi-angle seamless switching flag VOB FsV 
state, which IS settol to indicate interleaving is required. ngnag vub_i-sv 

frn.„^?*^.*!!f °* navigation pack NV (relative sector riumber from the VOB beginning) is detected 

ITJ^ Jif? ^''^^ ''""^^ "'^^^'"^ ^'^^"^ ^"^"'^^ ^ ^'9. 25. me navigation pa^Nvt 

S^i^SiS*T«^%"'cr2: T''^^'"^ presentation time ILVU.MT information (a foi^atter parameter 

for ^ample. .s thus obtained, and the title editing unit VOB is divided into interleave units using VOBU units 
tation «rJ^r ' x/Aon ^^"^'^ "^"""""^ '"^erleaved unit presentation time ILVU MT is 2 sec and the presen- 
« ^-^^ '"to '"»e^'eave units of 4 VOb'u each Note thatSSa- 

tion operation is applied to the VOB constituting each multi-scene date unit 

seauenS^rTS^Sl'^^'®^'^ ""S °* ^^'^^ "'^^^'^^^ ^^"^ «top #2380 are arranged in the cell block mode CBM 
SSeo £ Ih * f^'TE; ^""^ '^^"'^ "'"t^o' information for each scene In step 

nSfiSi^? ^^'"^ """^^ OBM declaratfons above, for example, the angle data MAI MA2 

and MAS (Fig. 23) are an^nged in that sequence. ' ' 

rFi« t^^^^ *® VOBU start is written to the VOB end pack address VOBU EA 

' Afit^ ^^rrrTn vnn^ ""^^^ °" ^'^^ '"to^-™""" Opined iS sti 

ov«™I 2r ?f ^ ^^^""^^^ C_FVOBU_SA and the last ceil VOBU start address C TvOBU SA 

^^.S ^ °* VTS title VOBS (VTSTT VOBS) S mSen i'me 

J??S?_^o1jrda?r^r^^^^^^ - - VTS t.e VoS 

rPio '^^oT^^f the relative sector number from the VOBU start is written to the VOB end pack address VOBU EA 
^'-^1 IT. ^SZ'^T.i:' °' ""^^^ °" '"'^^^^ oW^'ned Instep ^370. " 

SML^U So 2^?^ thfn« ■ SML_AGL_C9_DSTA of the seamiest angle information 

fJi. If ^' I "«^'9«*°n f^<^ NV of each VOBU is written at step #2390. This address is e^mressed as the 
relative sector number inside the data of the interleaved blocks formed in step #2382. and declares t^TaSiTnSr 

tH ^ ^ ^^"^ ''^ '^"^ VOBU Of all angTe scen« wHh SSrt SSo^^^^ 

the reproduction end time of the VOBU being processed - sian nme contiguous to 

SML^S^Co^Si. '^1'^^^^':" T*"^" *° * VOBU Start address SML AGL Cl DSTA - 

^ seamless angle information SML_AGLI (Fig. 20) in the navigation padc Nv"of the VOBU 

trSul^^eTe'S"'"' """""'^''""^^^^ 

This routine thus formats the interleaved blocks for multi-angle seamless switching control in the multi-scene 
period and formats the cell control information as the reproduction control information forUfrSXS scenes 

H. J "f^"**"' "^'e" *2318 in Fig. 56 retums NO iT vSen it is 

determined that paremaliockcontrol is implemented and not multi-angle control, isd^^^ 

♦h. ^^'^ 't'i i"^"*"® described below writes the interleave unit arrangement of the multimedia bitstream 

-cS^l '^^J °" P'^y^^* infomiation) shown in Fig. iHnd ^e nS^ton 

pack NV information shown in Fig. 20, to the generated DVD multimedia bitstream navigation 

C PbI #ZT^,^lTvnTl *° ^^"^ (f^'S- ^ 6> °* '^•l P'^yba'^k information blocks 

cb^n * '"'"9 VOB control information for each scene based on the multi-angle flag VOB Fm state whl^ 
set too to indicatethat multi-angle control is not enabled In the multi-scene period v^^.rm state, which is 

cont^lt^^trvor 'T!'^^^^^^ ^■"'9- ^ Playback information blocks C PBI #1 

SS?F^^Jll ht, . ^""^ '^^^^ °" preceding VOB seamless connection flag 

VOB_Fsb state, which is set to 1 to indicate a seamless connection "'ecuon lag 

tho ^A=®''!^'^fw*'® ^"^^ '^^^"^ ^"^0°'' to 1 in the cell playback informatfon blocks C PBI #i containino 

whicMs sX 1 t'otdTir T °" VOB seamless connection f Sg VOB 

wnicn IS set to 1 to indicate a seamless connection. ~ 

At step #2408 the interleaved allocation flag lAF (Fig. 16) is set to 1 in the cell playback information blocks C.PBI 
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#i containing the VOB control information for each scene based on the nnulti-angle seamless switching flag VOB_FsV 
state, which is set to 1 to indicate interleaving is required. 

At step #2410 the navigation pack NV position information (the relative sector number from the VOB start) is 
detected from the title editing unit (VOB) obtained from the system encoder 900 (Fig. 25). The navigation pack NV is 
then detected based on the number of interleaved VOB divisions ILV_DIV. a formatter parameter obtained in step #1874 
in Fig. 55. to obtain the VOBU position information (number of sectors from the VOB start), and divide each VOB into 
the specified number of interleave units in VOBU units. 

At step #2412 the interleave units obtained in step #2410 are then interleaved. For example, the interleave units 
are arranged in ascending :VOB number sequence tO:create the interleaved blocks as shown in Fig. 37 or 38, and the 
interleaved blocks are added to the VTS title VOBS (VTSTT_,VOBS). 

At step #2414 the relative sector number from the VOBU start is written to the VOB end pack address VOBU_EA 
(Fig. 20) in the navigation pack NV of each VOBU based on the VOBU position information obtained in step #2188 

At step #2416 the first cell VOBU start address C_FVOBU_SA and the last cell VOBU start address C_LVOBU_SA 
expressed as the number of sectors from the beginning of the VTS title VOBS (VTSTT_VOBS) are written as the 
15 addresses of the navigation packs NV of the first and last VOBU in each cell based on the VTS title VOBS 
{VTSTT_VOBS) data obtained in step #2412. 

At step #2418 the relative sector number to the last interleave unit pack is written to the ILVU end pack address 
ILVU_EA in the navigation pack NV of the VOBU forming the interleaved units based on the interleaved unit data 
obtained from step #2412. 

20 At step #2420. the relative sector numl^er in the interleaved block data formed in step #241 2 is written to the next- 
ILVU start address NT_ILVU_SA as the position information of the next ILVU in the navigation packs NV of the VOBU 
contained in the interleaved unit ILVU. 

At step #2422 the interleaved unit flag ILVU flag is set to 1 in the navigation packs NV of the VOBU contained in the 
interleaved unit ILVU. 

25 At Step #2424, the Unit END flag of the navigation pack NV in the last VOBU of the interleaved unit ILVU is set to 1 
At step #2426 TFFFFFFFh" is written to the next-ILVU start address NT_ILVU_SA of the navigation pack NV of the 
VOBU in the last interleaved unit ILVU of each VOB. 

The operation described above thus formats the interleaved blocks to enable parental lock control in the multi- 
scene periods, and formats the control information in the cells, i.e., the cell playback control information for the multi- 
30 scene periods. 

The single scene subroutine executed as step #2314 in Fig. 56 when steps #2312 or #2316 return NO, i.e. when 
the scene is determined to be a single scene and not a multi-scene period, is described next using Fig. 60. 

The single scene subroutine described below writes the interleave unit arrangement of the multimedia bitstream 
the content of the PGC information entries C_PBI #i (cell playback information) shown in Fig. 16. and the navigatior^ 
35 pack NV information shown in Fig. 20. to the generated DVD multimedia bitstream. 

At step #2430 a value "00b" indicating a "non-cell block", i.e., that there is only one cell in the functional block, is 
wntten to the cell block mode CBM (Fig. 16) of the cell playback information blocks C_PBI #i containing the VOB confrol 
information for each scene based on the multi-scene flag VOB_Fp state, which is set to 0 to indicate that the scene is 
a single scene and not part of a multi-scene period. 
40 At step #2432 the interleaved allocation flag lAF (Fig. 16) is set to 0 in the cell playback information ttocks C_PBI 
#i containing the VOB control infomriation for each scene based on the multi-angle seamless switching flag VOB_FsV 
state, which is set to 0 to indicate interleaving is not required. 

At step #2434 the navigation pack NV position information (the relative sector number from the VOB start) is 
detected from the title editing unit (VOB) obtained from the system encoder 900 (Fig. 25), placed in the VOBU unit and 
45 added to the VTS title VOBS {VTSTT_VOBS), the video and other stream data of the multimedia bitstream. 

At step #2436 the relative sector number from the VOBU start is written to the VOB end pack address VOBU_EA 
(Fig. 20) in the navigation pack NV of each VOBU based on the VOBU position information obtained in step #2434 

At st^ #2438 the first cell VOBU start address C_FVOBU_SA and the last cell VOBU start address C_LVOBuJsA 
expressed as the number of sectors from the beginning of and the end of, respectively, the VTS title VOBS 
50 (VTSTT_VOBS) of the value written as the addresses of the navigation pad© NV of the first and last VOBU in cell 
based on the VTS title VOBS (VTSTT^VOBS) data obtained in step #2434. 

At step #2440 the state determined as a result of step #300 or #600 in Fig. 51 . i.e., whether preceding VOB seam- 
less connection flag VOB_Fsb is set to 1 indicating a seamless connection to the preceding or following scenes, is eval- 
' uat^. ft step #2440 returns YES, the procedure moves to step #2442. 

At st^ #2442 the seamless playback flag SPF (Fig. 16) is set to 1 in the cell playback information blocks G_PBI #i 
containing the VOB control information for each scene based on the preceding VOB seaml^ connection flag 
VOB_Fsb state, which is set to 1 to indicate a seamless connection. 

At step #2444 the STC resetting flag STCDF is set to 1 in the cell playback information blocks C_PBl #i containing 
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I'ichTset to 1 . ^^"^ °" P^"''^'"^ ^^""^^^ ^lag VOB.Fsb state, 

step'^i^e*^^ ■ ^ "'^'"'^^ *° ^ P^°^"re moves to 

' con1^nS?re^OB ^rJ^'''^^^^^^ 1 6) is set to 0 in the cell playback information blocks C PBI#i 

5?>Tf^ Jntl^S^t, . ^''^ °" ^^'e preceding VOB seamless connection f La 

VOB_FEb state, which is set to 0 to indicate a non-seamless connection connection tiag 

th. vtA?^ ff^J^^ ^"^^ '^^'"^ *° 0 °ell playback information blocks C PBI #i containino 

.0 :iich°s sXo '^^^^^^ ^'^ ^^'^^ "^"^ '^"^ °" P^^^^'''"^ VOB seamless connecti^f^i vo^Fsb 

-nie operation described above thus formats a multimedia bitstream for a single scene period and records the eon 

^5 Decoder flow nhartg 

Disk-to-stream hiif fer transfer flow 

Hofo^^f °" P'*°^"^«* by the decoding system controller 2300 based on the scenario selection 

reoi^r^ T^Te" S;- ^'l!^ ^'^ comprises a scenario information register and a celt information 

ID SPJD_reg, and the system clock reference SCR buffer SCR_buffer ~ «UL.iu_iD_reg. sub-picture 

duc.^n"o;«i: ?ea'^-''°-^^ '^'^ - multiple angles in the repro- 

The VTS number VTS_NO_reg records the number of the next VTS reproduced from among the plumi VTS on the 
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The audio ID AUDIO ID reg recoreJs which of the plural audio streams in the VTS are to be reproduced 
MuraT's^iSl^^^heTr^^^^^ 

SCR?e^SSn°!^ 'I^r^ ^^"^ u""^' ^^""-"^^ « buffer for temporarily storing the system clock reference 
fe?era.S S^RTs^^t^w '''^"'^ "^'"^ ^^9- ^6. this ten^oraril^red system dS 
■^f!.! if ^ decoding system controller 2300 as the bitstream control data Stk 

TTie cell information register contains the following sub-registers- the cell block mode trm m ^ * 

CBT_reg. seamless reproduction flag SPF.reg. intended alloS fl^ l?F "rSTC resSm~mg s?CDFtim' 
Tl^^IsT^T^ ^""'^^ C_FVOBU_SA_rea'aS S7J5lu aTei" 

aro nTH!.? CBM reg stores a value indicating whether plural cells constitute one functional block If there 

so Locf^ ^ ^ ^^-'^^ °* <^«"« between the first and lait cells in tt^e 

If thecell block is a mult-angle blocK A_BLOCK is stored: if not. N_BLOCK is stored t.BM_reg. 

. riSi™— °— ^^^^^ 

leav2blLTir^f«i!^^^ T ^? ^"'^ ^ "^'"^ in a contiguous or Inter- 

leaved block^ If the cell IS part of a an interleaved block. ILVB is stored; othemvise N ILVB is stored 

The STC resetting flag STCDF defines whether the system time clock STC useJfor synchronization must be reset 
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when the cell is reproduced; when resetting the system time clock STC is necessary. STC RESET is stored- if resetHno 
IS not necessary, STC_NRESETIs stored. oociuna 

The^ess angle change flag SACF.reg stores a value indicating whether a cell in a multi-angle period should 
seamlessly at an angle change. If the angle change is seamless, the seamless angle change flag SACF 
IS set to SML; otherwise it is set to NSML. ^ ^ 

The first cell VOBU start address C_FVOBU_SA_reg stores the VOBU start address of the first cell in a block The 
)Sr"cT? Sfnff expressed as the distance from the logic sector of the first cell in the VTS title VOBS 

(VTSTT_VOBS) as measured by and expressed (stored) as the nuniier of sectors 

The last cell VOBU start address C_LVOBU_SA_reg stores the VOBU start address of the last cell in the block. The 
°* S'^^iJ^'^ ^ expressed as the distance from the logic sector of the firet cell in the VTS tftle VOBS 
(VTSTT_VOBS) measured by and expressed (stored) as the nunijer of sectors 

The decoding table shown in Fig. 63 is described below. As shown in Rg . 63. the decoding table comprises the fbl- 
LrrcPr3?,^o v/;^S.T!ll,°" ^^«ters for non-seamless multi-angle control, information registers Ibr seamless multi- 
angle control, a VOBU informaton register, and information registers for seamless reproduction 

McIIl®'I^,T*'°Il^^'^®'®*°'"°""®®^'"'®^™'*'"^"9'®^'«'^<=°'"^^^ AGL C1 DSTA reg 

- N5ML_AQL_C9_DSTA_reg. ~ ~ ~ ~ ** 

MMc5'^Ai7^?i-S^?®'^f- ^ " NSML_AGL_C9_DSTA_reg recoiti the NMSL AGL Cl DSTA - 
NMSL_AQL_C9_DSTA values in the PCI packet shown in Fig. 20. ~ 

^KA,^^r^^,^^/^^^ ^ seamless multi-angle control comprise sub-registers SML AGL Cl DSTA reg - 

SML_AGL_C1_DSTA_reg - SML_AGL_C9_DSTA_reg record the SML AGL Cl DSTA - SML AGL 09 DSTA 
values in the DSI packet shown in Fig. 20. - - _ _ «l,_v/3_uoi« 

The VOBU information register stores the end pack address VOBU_EA in the DSI packet shown in Fig 20 
25 lLVU^ten?rnr™^'^nMiT^^^ comprise the following sub-registers: an interleaved unit flag 

^rti^^'ii? M UNIT_END_flag_reg. Interleaved Unit End Address ILVU_EA_reg. Next Interleaved UnS 

Start Address NTJLVU_SA_reg. the presentation start time of the first video frame in the VOB (Initial Video Frame 
Presentatm Start Time) VOB_V_SPTM_reg. the presentaton end time of the last video frame in the VOB (rSi nSS 
^-I^^T Temiination Time) VOB_V_EPTM_reg. audio reproduction stopping time 1 

oeL\^B^7fd^'^T° '"P"?"*^"" ^PP'"9 ^-"^ 2 V0B_A_STF_PTM2_reg. audio reproducfion stopping 
period 1 V0B_A_GAP_LEN1_reg. and audio reproduction stopping period 2 VOB_A_GAP_LEN2 reg 

The interleaved unit flag ILVU_flag_reg stores the value indicating whether the video object"unit' VOBU is in an 
interleaved block, and stores ILVU if it is, and NJLVU if not. j u vv^du is m an 

v/n JI^ END flag UNIT_END_flag_reg stores the value indicating whether the video object unit VOBU is the last 
UNnZnV f ""^rV- ^^'^'^ '^^ interleaved unit ILVU is the date unit for continuous reading, the 

UNIT_ENp^flag_reg s ores END if the VOBU currently being read is the last VOBU in the interleaved unit ILVU and 
Otherwise Stores N_END. . 

h.ioI!!!/f'ri'^m End Address ILVU_EA_reg stores the address of the last pack in the ILVU to which the VOBU 

SSc oTtSa VObS. ^" ™" ^^^"^^ °< sectors from the navigation 

» «, JiASf Start Address NT_ILVU_SA_reg stores the start address of the next interleaved unit ILVU 
NVoft?aWoSf"'^ 

ofth?f:^:sioSs.e'r^^^^^^ 

entaS: oTi^rvidSTra^^S^^^^^^^ ^"^^ VOB_V_EPTM.reg stores the «me at w„ich pres- 
to ^^""^'°^«P^'^"<*°"stoPPi^ 1 VOB_A^STP_PTVI1_reg stores the timeatwhichtheaudio is to be paused 
to eiableresynchronization, and the audio reproduction stopping period 1 VOB A GAP LEN1 reg stores the lenoth 
of this pause period. ~ - 

vnJ? rA?. p1S^°^"'^i" ^^^'"^ ^ V0B_A.STP_PTM2_reg and audio reproduction stopping period 2 
VOB_A_GAP__LEN2_reg store the same values. -kk a h ^ ^ 

K , "^^^^P®?*'^" °* DVD decoder DCD according to the present invention as shown in Fig. 26 is described next 
below with reference to the flow chart in Fig. 69. u«>wiuea nexi 

55 #3102(2^" ^'"^ determined whettier a disk has been inserted. If it has. the procedure moves to step 

At step #310204. the volume file structure VFS (Fig. 21) is read, and the procedure moves to step #31 0206 
At step #310206. the video manager VMG (Fig. 21) is read and the video title set VTS to be reproduced is 
extracted. The procedure then moves to step #310208. 
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Programchain reproduction in step #310216 above is described in further detail below referrina to Fin t>,o r,rn 

Once the decoding system table is defined, the process transferring data to the stream buffer fsteo «1 «nH 
the process decoding the data in the strearr, buffer (step #31034) are acLated in paraff ^ 

Note that step #31032 and Step #31034 are executed in parallel 

stream^l^!r nJjflr further detail below referring to Fig 70 The 

M 1'^ determined whether the cell is a multi-angle cell. If not the procedure moves to step #301 44 

At step #31044 the non-multi-angle cell decoding process is executed ^ 

The ,Kn-mM^ „«,eaved Mock p^cess (s,^«,052. Fig. 71) Is descrtbed ft,dte b«oJ^ STSr^, 
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Fig. 72. 

At step #31060 the reading head 2006 is jumped to the first cell VOBU start address C FVOBU SA read from the 
C_FVOBU_SA_reg register. ~ 

More specifically, the address data C_FVOBU_SA_reg stored in the decoding system controller 2300 (Fig 26) is 
input as bitstream reproduction control signal St53 to the reproduction controller 2002. The reproduction controller 2002 
thus controls the recording media drive unit 2004 and signal processor 2008 to move the reading head 2006 to the 
specified address, data is read, error correction code ECC and other signal processing is accomplished by the signal 
processor 2008. and the cell start VOBU data is output as the reproduced bitstream St61 to the stream buffer 2400 The 
procedure then moves to.step #3.1062. 

At step #31062 the DSI packet data in the navigation pack NV (Fig. 20) is ^racted in the stream buffer 2400 the 
decoding table is defined, and the procedure moves to step #31064. The register set in the decoding table are the 
ILVU_EA_reg, NTJLVU_SA_reg. VOB_V_SPTM_reg. VOB_V_EPTM reg. VOB A STP PTM1 rea 
V0B_A_STP_PTM2_reg, V0B_A_GAP_LEN1_reg. and V0B_A_GAP_LEN2_reg.~ - - - - a. 

At step #31064 the data from the first cell VOBU start address C_FVOBU_SA_reg to the ILVU end pack address 
ILVU_EA_reg. i.e.. the data for one interleaved unit ILVU. is transferred to the stream buffer 2400. The procedure then 
moves to step #3 1 066. 

More specifically, the address data ILVU_EA_reg stored in the decoding system controller 2300 (Rg 26) is sup- 
phed to the reproduction controller 2002. The reproduction controller 2002 thus controls the recording media drive unit 
2004 and signal processor 2008 to read the data to the ILVU_EA_reg address, and after error correction code ECC and 
other signal processing is accomplished by the signal processor 2008. the data for the firet ILVU in the cell is output as 
the reproduced bitstream St61 to the stream buffer 2400. It is thus possible to output the data for one contiguous inter- 
leaved unit ILVU on the recording medium M to the stream buffer 2400. 

At step #31066 it is determined whether ail interleaved units in the interleaved block have been read and trans- 
ferred. If the interleaved unit ILVU processed is the last ILVU in the interleaved block. "0x7FFFFFFF" indicating termi- 
nation IS set to the next-ILVU start address NT_ILVU_SA_reg as the next read address. If all interleaved units in the 
interleaved block have thus been processed, the procedure moves to step #31 068. 

At step #31 068 the reading head 2006 is again jumped to the address NT_ILVU_SA_reg of the next interleave unit 
to be reproduced, and the procedure loops back to step #31062. Note that this jump is also accomplished as described 
above, and the loop from st^ #31062 to step #31068 is repeated. 

However, if step #31066 returns YES. i.e.. ail interleaved unit ILVU in the interleaved block have been transferred 
step #3 1 052 terminates. 

The non-multi-angle interleaved block process (step #31 052) thus transfers the data of one cell to the stream buffer 

2400. 

The non-mutti-angle contiguous block process is executed in step #31 054. Fig. 71 . is described further below with 
35 reference to Fig. 73. 

At step #31070 the reading head 2006 is jumped to the first cell VOBU start address C_FVOBU_SA read from the 
C_FVOBU_SA_reg register. This jump is also accomplished as described above, and the loop from step #31 072 to steo 
#31076 is initiated. ''^ 

At step #31072 the DSI packet data in the navigation pack NV (Fig. 20) is extracted in the stream buffer 2400 the 
decoding table is defined, and the procedure moves to step #31074. The registere set in the decoding table are the 
VOBU_EA_reg. VOB_V_SPTA/l_reg. VOB_V_EPTM_reg. VOB_A STP PTM1 reg. VOB A STP PTM2 rea 
V0B_A_GAP_LEN1_reg, and VOB_A_GAP_LEN2_reg. ~ " ~ ' r--^- 1 ivu;_reg. 

'^^^ ""^ ^ address G_FVOBU_SA_reg to the end pack address 

VOBU_EA_reg. i.e.. the data for one video object unit VOBU. is transferred to the stream buffer 2400. The procedure 
then moves to step #31 076. The data for one video object unit VOBU contiguously arrayed to the recording medium M 
can thus be transfen-ed to the stream buffer 2400. 

At step #31 076 it is determined whether all cell data has been transferred. If all VOBU in the cell has not been trans- 
ferred, the data for the next VOBU is read continuously, and the process loops back to step #31070 

However, if all VOBU data in the cell has been transferred as determined by the C_LVOBU_SA_reg value in step 
4^1076. the non-multi-angle contiguous block process (step #31054) terminates. This process thus transfers the data 
of one cell to the stream buffer 2400. 

Another method of accomplishing the non-multi-angle cell decoding process (step #31044 Fig 70) is described 
below with reference to Fig. 74. ^ 

At step #31 080 the reading head 2006 is jumped to the first cell VOBU start address C_FVOBU_SA_reg and the 
first VOBU data in the cefl is transfen-ed to the stream buffer 2400. The procedure then moves to step #31081* 

At step #31 081 the DSI packet data in the navigation pack NV (Fig. 20) is extracted in the stream buffer 2400 the 
decoding table is defined, and the procedure moves to step #31082. The registers set in the decoding table are the 
SCR_buffer. VOBU_EA_reg. ILVU_flag_reg, UNIT_END_flag_reg, ILVU_EA_reg. NT_ILVU SA reg 
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voPM "^^^ *® "^^^^ address C_FVOBU SA reg to the end pack address 

t.^arrA°2L^teT::Sdr^^^^^^^ 

backT^*l3??^f If r'""^ whether the VOBU is the last VOBU in the interleaved mil If not. the process loops 
The loop from step #31081 to step #31084 repeats as described above 

At Step #31086 the reading head 2006 is jumped to the address NT ILVU SA reg of the next interleave unit anH 
'l^^timleTmrar^^^^^^^ 

Ttie seamless multi-angle decoding process executed in step #30146. Fig. 70. is described below referring to Fig. 

C FCoBfrS^?f FVOBU SAreadfromIhe 

C FVOBU.SA reg register, and the first VOBU data in the cell is transferred to the stream buffer 245o T>?Dr2S.7rp 

6ec^S^eT6^'!n£^l^T ''"^i" ^^"^ ''^ buffer 2400 the 

n^rs^a^^^i^i^-™^^^ 

siZb:,ir2"ir'''*°°"^''*'^'^*^'"^°"^~^^^^^^^ 

rese^ t?rA*NQ2?NO Z't^h'"'-?^ " updated, and the procedure moves to step #31094. This update operation 
S^e\^nari^sefei^^^^^ °' ^"^'^ ^^--^es th'e angle 

ttis thus possible to transfer the data for the angle selected by the user to the stream buffer 2400 in ILVU units 
to p^3%"°"-^--'«- "-"-"^'^ d-«>ding process is executed in step #30148. Rg. 70. is des^b^ bZ rearing 

C pJn?M FVOBU SAreadfromIhe 

C_FVOBU_SA_reg register, and the first VOBU data in the cell is transferred to the stream buffer 2i'rTrnrSr;^! 

H S °J P*'^* ^^"^ navigation pack NV (Fig. 20) is extracted in the stream buffer 24on 

2^^^^ .VS'l" ' S^T ^^^^"^ ''""^^ 2400:Th^procedure then ZLs fo sS 
t?e Zm bili" 2'So *° "'"'^"""^ "^^^'^ ^OBU - recording m^Tum S to 

reseSSe ANGi!?NO Cfft^h^"?"?^ T*'?'^' ""'"^"'^ *° *31104. This update operation 

S^Tthe s^na!;^s^^^^^ ^"^'^ ^^'^'^^^^ ^'^^ '^^nses th'e angle 

h.pn'^lfn^ determined whether the angle cell data has all been transferred. If all VOBU in the cell have not 

been transferred, the procedure moves to step #31 105. If all VOBU in the cell have been transferred fte p^^ess ter^ 



52 



BNSDOCID: <EP 084720OA1_l_> 



EP0 847 200 A1 



'10 - 



25 



minates. 

At step #31105 the reading head 2006 is jumped to the next angle (NSML_AGL_C#n_reg). and the process 
advances to step #31106. Note that NSML_AGL_C#n_reg is the address of the angle to which the ANGLE_NO reg 
was updated in step #31 1 03. ~ 
It is thus possible to transfer the data for the angle selected by the user to the stream buffer 2400 in VOBU units. 
Step #31106 is an effective step for high speed angle switching, and simply dears the stream buffer 2400. By thus 
clearing the stream buffer 2400 the data for the newly selected angle can be reproduced without reproducing the angle 
data that is still not decoded. In other words, clearing the stream buffer 2400 enables faster response to user opera- 
tions. 

It is very important that DVD decoder according to the present invention can promptly moves to the next data read- 
ing process and effectively performs the data reading once after the detection of the end of data such as interleave unit 
ILVU and video object unit VOBU for the sake of seamless reproduction which is one of main targets of the present 
invention. 

With reference to Fig. 66. a construction of the stream buffer 2400 which can performs the end detection of inter- 
15 leave unit ILVU is described briefly. The stream buffer 2400 comprises a VOB buffer 2402, a system buffer 2404. a nav- 
igation pack extractor 2406, and a data counter 2408. The system buffer 2404 temporarily stores the title control data 
VTSI(Fig. 16) included in signal St61 , and outputs a control information St2450 {St63) such as VTS_PGC. 

The VOB buffer 2402 temporarily stores the title VOB data VTSTT_VOB (Fig. 1002). and the stream St67 to the 
system decoder 2500. 

20 The NV (navigation pack) extractor 2406 receives the VOB data at the same time with the VOB buffer 2402, and 
extracts the navigation pack NV therefrom. The NV extractor 2406 furthermore extracts the VOBU final pack address 
COBU_EA or ILVU final pack address ILVU_EA which are the DSI generation information DSLGI shown in Fig 19 to 
produce a pack address information St2452 (St63). 

The data counter 2408 receives the VOB data at the same time with the VOB buffer 2402. and counts each of pack 
data shown in Fig. 19 byte by bye. Then, the data counter 2408 produces a pack input terminating signal St2454 {St63) 
at the time when the inputting of pack data is completaj. 

Due to its construction shown in Fig. 66, the stream buffer 2400 performs the VOBU data transfer as examples at 
step #31064 of Fig. 72, as follows. The stream buffer 2400 outputs the VOBU data for the NV extractor 2406 and data 
counter 2408 at the same time when the VOBU buffer 2400 receives the VOBI data on the top of interleave unit ILVU 
As a result, the NV extractor 2406 can extracts the data of ILVU_EA and NT_ILVU_SA at the same time with the input- 
ting of navigation pack data NV. and outputs thereof as signal St2452 {St63) to the decode system controller 2300 (Fiq 
26). 

The decode system controller 2300 stores the signal St2452 into the ILVU_EA„reg and rsrT_ILVU_SA_reg. and 
then start to counts the number of packs based on the pack terminating signal 2452 from the data counter 2408. Based 
on the fore mentioned the counted value of packs and ILVU_EA_reg. the decode system controller 2300 detects the 
instance when the inputting of final pack data of ILVU is completed, or the inputting final byte data of the final pack of 
the ILVU is completed. Then, the controller 2300 further give a command for the bitstream reproducer 2000 to move to 
the position having a sector address indicated by NT_ILVU_SA_reg. The bitstream producer 2000 moves to the sector 
address indicated NT_ILVU_SA_reg. and starts to read the data. Thus, the detection of final end of ILVU and reading 
40 process for the next ILVU can be performed effectively 

In the above, an example where the multimedia data MBS is reproduced by the bitstream r^roducer 2000 without 
a buffering process, and is inputted to the stream buffer 2499. However, in the case that the signal processor 2008 of 
the bitstream reproducer 2000 is incorporated with a buffer for en-or correction process, for example, the controller 2300 
gives a moving command to r^roducer 2000 so that the reproducer 2000 moves to the reading position indicated by 
45 NT_ILVU_SA_reg after completion of the final pack data of fore mentioned ILVU and clearing the internal buffer of the 
reproducer 2000. Thus, the effective reproduction of ILVU data even when the bitstream reproducer 2000 includes a 
buffer lor error correction code (ECO) process. 

Furthermore, when the bitstream producer 2000 has a buffer for ECC process, the data can be transferred effec- 
tively by providing any means having a function equivalent to that of data counter 2408 (Fig. 66). In other words the 
50 bitstream reproducer 2000 generates the pack input completion signal St62: the decode system controller 23O0 gives 
a command based on the signal St62 the bitstream reproducer 200 to move to the reading position having sector 
address designat«l by NT_ILVU_SA_reg. As apparent from the above, the data can be transferred effectively even 
when the bitstream reproducer 2000 has a function to buffer.the data rqDroduced from the recording media M. 

It is to be noted that the apparatus and method substantially the same as those described in the at>ove with respect 
55 to the interleave unit ILVU can be us&A for the detection VOBU end. In other words, by r^lacing the extraction of 
iLVU_EA and NTJLVU_Sa. and the storing of ILVU_EA_reg and NT_ILVU_SA_reg with the extraction of VOBU_EA 
and storing VOBU_EA_reg. the apparatus and method according to the present invention, described above, can be 
used for the detection of an_@end. This is effective for the VOBU data transferring operations shown at steps #31074, 



30 



35 



53 

BNSDOCID: <EP 0847200A1J_> 



EP 0 847 200 A1 



10 



IS 



20 



25 



3S 



40 



45 



SO 



ss 



#31082, #31092, and #31102. 

Thus, the reading of data such as ILVU and VOBU can be periormed effectively. 
Decoding flows in fh^ stream htrffBr 

rina L^Fi^' ''^'"^ '^'^ ^^"^ ^"^^ «^ 64 is described below refer- 

ring to Rg. 67. This process (step #31034) comprises steps #31 110. #31 1 12. #31 1 14. and #31 1 16 

TheJISreVhln^irstT^lm*"^ 

pctuCISefam L'r^iTudl'Srl'Sr' *° °^ ^''^^ '^^^ 

sub J!4m« m qp^.?^ "^If^ the user-selected audio and sub-picture data, i.e., the audio ID AUDIO ID reg and the 
StC^^I M -^-^ f *° ^"^"^"^ information register shown in Fig. 62. are compared "with the s"ream 

i^^^rhet2xrn^r^xrir^^^^^^ 

#31n4^^°2^H''^;!f °* ■^^'^^'r^ '^^"^^'^ ^nd audio decoders) Is controlled in step 

Not tttS H °* synchronized, and the procedure moves to step *?1 1^6 

T^r^^ synchron,zat.on process of step #31 1 14 is described below with reference to Rg i 

deco^i tSS'fm'n^Z^ Z fr'r The video decoder 3801 thus reads and 

h.!^?1 1 '^^^^ sub-p>cture decoder 3100 reads and decodes the data from the sub-picture 

buffer, and the audio decoder 3200 reads and decodes the data from the audio buffer ^ 

ISe iSE^"!n^'!«*^ t"""^'"^ terminates when these decoding processes are completed. 

The decoder synchronization process of step #31 1 14. Fig. 67. is described below with reference to Fia 68 Thic; 
processes comprises steps #31 120, #31 122. and #31124. reierence to Pig. 68. This 

r^iH f ^ " *^ determined whether a seamless connection is specified between the current cell and the pre- 
ceding cell. If a searjiless connection, the procedure moves to step #31 122. if not. the procedure moves to^ 

A process synchronizing operation for producing seamless connections is executed in step ST^S and a S^c^s 
synchronizing operation for non-seamless connections is executed in step #31 124 ^ 

frnrr, ^^0?'"^."^'^ ^^^"^ ~T'^'"^ ^^^"^ Comprising audio and video data representing views 

different perspechves is thus constructed by means of the present invention described above. Using the resuZ 
m^-angle system stream, an observer can during media presentation dynamically and freely swrtch theTylm 
streams representng each of the angles at predefined unit intervals. To accomplish this the system^rearrJjnr 

ttTteml'imf '""^ °^ ^''^^'^ ^'^^^^ times ofte a^rdarcTnti'^Tn 

the system streams corresponding to each angle are the same in each of the particular units at which switaWr^a 
bewjeen arigles is posstole. As a result, when the user changes from one angle to another angle afan^iXoin't 

the audio will not be disrupted with noise or intermitted, and the audio and video can thus be smoothly s^tch^T 
Moreover, because the audio data contained in the system streams corresponding to each angte is t^ S^ in the 

scene period as though changing the camera position. 
Industrial Applicability 

As apparent from the above, a method and an apparatus, according to the present invention for interleavina a bit 
SSmfh '^""""^ the interleaved bitstream on a recording medium and reproducing the recoid^lmerj^Ci t^^^^^ 
S SI . " ^""^r^' ^" ^"^"^^"S ^y^te'" ^'<^*' can generate a new title by editing a title SnsTuSS bit- 

srviroTS°orS;s^^^^^^ 

Claims 

^' ^?itc ""^a^ "^^'^^ presentation of a bitstream that is reproduced by selecting two or more data 

«i -^^K^ ^'^ ^ comprising three or more data units (VOB) contiguous on the same time-bLi° s cha^ 

actenzed by generatng said bitstream by arranging the selected data units (VOB) in a particular ^uence on I 
same tim^base based on the presentation time of each data unit (VOB) so that is possible to sequ^S^acce^ 
all date unte (VOB) and present only the selected data units (VOB) without time-base irtermiltence and s charaJ 
tenzed by dividing said data units (VOB) into shortest-read -time data units (ILVU), and generating said biSream 
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by arranging the shortest-read-time data units (ILVU) in a particular sequence on the same time-base based on the 
shortest read time each shortest-read-time data unit (ILVU) so that it is possible to sequentially access all shortest- 
read-time data units (ILVU) and present only the shortest-read-time data units (ILVU) of the selected data units 
(VOB) without time-base intermittence. said presentation time of each shortest-read-time data unit (ILVU) being the 
same 
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An interleaving method according to Claim 2 wherein the.shortest-read.time data units (ILVU) are completely self- 
contained data unrts. the presentation of which does not require referencing any other shortest- read-time data unit 



4. An interleaving method according to Claim 2 wherein the shortest-read-time data units (ILVU) are closed 
IS group_of_pictures GOP based on the MPEG standard. 

^' ^J"'™^^^ ""^^ presentation of a bitstream that is reproduced by selecting two or more data 

units (VOB) from a bitstream comprising three or more data units (VOB) contiguous on the same time-base is char- 
acterized by generating said bitstream by arranging the selected data units (VOB) in a particular sequence on the 
same time-base based on the presentation time of each data unit (VOB) so that it is possible to access and present 
without time-base intermittence only the selected data units (VOB). and is characterized by dividing said data units 
(VOB) into shortest-read-time data units (ILVU), and generating said bitstream by arranging the shortest-read-time 
data units (ILVU) in a particular sequence on the same time-base based on the read time of each shortest-read- 
time data unit (ILVU) so that it is possible to access and present without time-base intermittence only the shortest- 
read-time data units (ILVU) of the selected data units (VOB). said presentation time of each shortest-read-time data 
unit (ILVU) being the same. 

An interleaving method according to Claim 5 wherein the shortest-read-tme data units (ILVU) are the same audio 
data. 
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